-- Logs begin at Mon 2022-07-25 23:10:12 UTC, end at Tue 2022-07-26 00:24:10 UTC. -- Jul 25 23:57:30.007699 dv-osbrick-849840-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 23:57:30.017962 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 23:57:30.019999 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 23:57:30 2022] *** Jul 25 23:57:30.019999 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 23:57:30.019999 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 23:57:30.019999 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: nodename: dv-osbrick-849840-4-ceph Jul 25 23:57:30.019999 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: machine: x86_64 Jul 25 23:57:30.019999 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: clock source: unix Jul 25 23:57:30.019999 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: pcre jit disabled Jul 25 23:57:30.019999 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: detected number of CPU cores: 4 Jul 25 23:57:30.019999 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: current working directory: / Jul 25 23:57:30.019999 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: detected binary path: /usr/bin/uwsgi-core Jul 25 23:57:30.019999 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: your processes number limit is 47680 Jul 25 23:57:30.020608 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: your memory page size is 4096 bytes Jul 25 23:57:30.020608 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: detected max file descriptor number: 2048 Jul 25 23:57:30.020608 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: lock engine: pthread robust mutexes Jul 25 23:57:30.020608 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: thunder lock: enabled Jul 25 23:57:30.020608 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 23:57:30.020608 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 23:57:30.064368 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: Python main interpreter initialized at 0x563f5d8a79c0 Jul 25 23:57:30.064368 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: python threads support enabled Jul 25 23:57:30.064368 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: your server socket listen backlog is limited to 100 connections Jul 25 23:57:30.064368 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: your mercy for graceful operations on workers is 90 seconds Jul 25 23:57:30.064686 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 23:57:30.064784 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: *** Operational MODE: preforking *** Jul 25 23:57:30.065042 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: *** uWSGI is running in multiple interpreter mode *** Jul 25 23:57:30.065042 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: spawned uWSGI master process (pid: 87298) Jul 25 23:57:30.065238 dv-osbrick-849840-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 25 23:57:30.065989 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: spawned uWSGI worker 1 (pid: 87308, cores: 1) Jul 25 23:57:30.066115 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: spawned uWSGI worker 2 (pid: 87309, cores: 1) Jul 25 23:57:30.066250 dv-osbrick-849840-4-ceph devstack@keystone.service[87298]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 23:57:35.812619 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 23:57:35.812619 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: from cryptography.utils import int_from_bytes Jul 25 23:57:35.813418 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 23:57:35.813418 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: from cryptography.utils import int_from_bytes Jul 25 23:57:35.814439 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 23:57:35.814439 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: from cryptography.utils import int_from_bytes Jul 25 23:57:35.814894 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 23:57:35.814894 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: from cryptography.utils import int_from_bytes Jul 25 23:57:35.863285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 23:57:35.863478 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 23:57:35.863672 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] command line args: [] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 23:57:35.863940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 23:57:35.864117 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ================================================================================ {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 23:57:35.864369 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] admin_token = **** {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.864613 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] config_dir = [] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.864771 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 23:57:35.864850 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.864970 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] config_source = [] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.865051 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 23:57:35.865151 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] debug = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.865229 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] command line args: [] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 23:57:35.865350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.865635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 23:57:35.865635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ================================================================================ {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 23:57:35.865757 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.865815 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] admin_token = **** {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.865876 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.866061 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] config_dir = [] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.866149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.866261 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.866371 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.866449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] config_source = [] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.866592 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] debug = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.866701 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] list_limit = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.866839 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] log_config_append = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.866948 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.867075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.867178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.867277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] log_dir = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.867376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.867478 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] log_file = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.867582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.867694 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.867805 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.867887 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.868006 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] list_limit = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.868088 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.868164 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] log_config_append = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.868278 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.868353 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.868465 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.868540 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] log_dir = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.868662 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.868739 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] log_file = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.868857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.868937 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.869050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.869162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.869282 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.869402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.869519 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.869636 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.869636 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.869848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.869970 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.870074 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.870183 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.870295 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.870405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.870524 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.870636 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.870788 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.870904 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.871037 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.871142 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.871265 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.871378 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] publish_errors = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.871494 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.871605 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.871723 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.871840 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.871952 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.872066 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.872179 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.872335 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.872461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.872575 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] publish_errors = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.872684 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] standard_threads = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.872794 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.872922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.873045 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.873157 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.873268 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.873392 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.873392 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] use_journal = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.873706 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.873864 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] use_json = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.873864 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] use_stderr = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.874114 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] use_syslog = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.874281 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.874420 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.874541 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] standard_threads = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.874660 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.874805 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.874928 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.875040 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.875152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.875262 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.875379 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.875497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] use_journal = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.875497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] use_json = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.875723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.875841 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] use_stderr = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.875953 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.876063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] use_syslog = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.876164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.876258 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:57:35.876368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.876464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.876558 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.876657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.876752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.876851 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.876956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.877057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.877175 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.877288 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.877399 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.877510 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.877631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.877748 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.877860 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.877976 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.878088 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.878206 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.878334 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.878447 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.878563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.878675 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.878821 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.878943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.879131 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.879252 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.879365 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.879475 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.879586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.879704 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.879828 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.879941 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.880053 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.880169 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.880282 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.880393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.880516 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.880629 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.880739 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.880857 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.880975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.881092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.881212 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.881330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.881443 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.881554 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.881664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.881780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.881902 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.882014 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.882125 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.882236 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.882347 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.882468 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.882586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.882718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.882843 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.882965 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.883085 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.883205 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.883317 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.883428 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.883538 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.883649 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.883759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.883877 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.883990 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.883990 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.884205 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.884322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.884433 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.884619 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.884734 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.884845 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.884957 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.885074 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.885186 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.885309 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.885421 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.885532 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.885642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.885759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.885871 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.885990 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.886103 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.886214 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.886325 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.886441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.886559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.886679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.886843 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.886962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.887076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.887187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.887298 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.887417 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.887529 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.887646 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.887758 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.887869 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.888011 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.888139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.888253 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.888365 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.888476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.888594 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.888707 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.888830 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.888944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.889597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.889788 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.889932 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.890046 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.890206 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.890352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.890467 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.890589 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.890717 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.890717 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.890951 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.890951 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.891173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.891287 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.891406 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.891519 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.891631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.891755 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.891869 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.891990 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.892104 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.892216 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.892329 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.892442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.892562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.892676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.892788 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.892900 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.893002 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.893113 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.893234 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.893349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.893461 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.893573 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.893685 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.893806 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.893925 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.894039 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.894150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.894263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.894374 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.894495 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.894609 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.894753 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.894879 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.894999 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.895119 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.895241 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.895355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.895474 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.895587 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.895698 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.895810 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.895931 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.896045 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.896163 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.896277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.896388 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.896508 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.896697 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.896812 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.896924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.897036 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.897149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.897261 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.897381 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.897503 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.897638 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.897759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.897881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.897881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.898093 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.898197 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.898315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.898428 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.898540 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.898653 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.898815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.898930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.899054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.899177 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.899292 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.899404 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.899517 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.899630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.899751 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] auth.external = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.899865 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.899977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.900089 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.900201 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.900322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.900436 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.900596 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.900715 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] auth.password = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.900828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.900942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] auth.token = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.901067 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.901286 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.901487 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.901683 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.901821 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] auth.external = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.901936 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.902050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.902164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.902290 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.902407 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.902521 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.902635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.902788 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] auth.password = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.902907 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.903030 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] auth.token = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.903145 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] credential.caching = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.903259 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.903372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.903486 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.903599 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.903725 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.903842 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.903956 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.904069 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.904183 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.904296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.904418 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.904533 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.904707 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.905367 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.905531 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] credential.caching = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.905657 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.905789 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.905905 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.906020 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.906135 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.906249 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.906363 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.906485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.906600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.906600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.906876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.906991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.906991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.907232 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.907348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] federation.caching = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.907461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.907580 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.907694 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.907812 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.907935 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.908059 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.908173 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.908285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.908398 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.908510 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.908632 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.908747 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.908859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.908972 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.909087 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.909200 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.909321 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.909436 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.909549 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] federation.caching = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.909662 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.909775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.909887 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.910009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.910124 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.caching = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.910237 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.910351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.910464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.910577 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.910698 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.910833 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.910950 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.911064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.911178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.911292 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.911488 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.911606 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.911720 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.911833 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.911946 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.912067 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.912182 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.912296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.912410 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.caching = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.912523 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.912636 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.912758 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.912758 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.912971 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.913084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.913204 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.913204 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.913427 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.913541 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.913654 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.913767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.913879 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.913993 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.914114 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.914229 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.914343 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.914457 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.914570 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.914682 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.914836 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.914937 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.915049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.915163 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.915275 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.915389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.915511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.915626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.915739 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.915852 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.915965 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.916077 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.916199 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.916313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.916428 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.916428 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.916640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.916753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.916877 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.916877 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.917092 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.917205 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.917317 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.917430 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.917553 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.917667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.917786 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.917900 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.918014 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.918126 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.918257 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.918372 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.918485 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.918485 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.918749 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.918749 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.918979 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.918979 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.919193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.919295 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.919391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.919487 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.919591 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.919690 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.919785 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.919888 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.919985 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.920151 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.920305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.920505 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.920611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.920611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.920861 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.920965 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.921072 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.921190 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.921318 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.921457 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.921556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.921556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.921837 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.921945 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.921945 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.922147 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.922265 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.922390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.922497 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.922595 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.922693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.922839 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.922943 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.923107 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.923107 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.923345 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.923460 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.923558 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.923654 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.923776 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.923902 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.924039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.924202 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.924324 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.924429 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.924538 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.924637 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.924739 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.924837 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.924934 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.925028 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.925133 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.925231 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.925325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.925420 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.925517 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.925612 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.925716 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.925822 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.925919 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.926014 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.926110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.926211 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.926316 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.926413 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.926509 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.926610 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.926723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.926827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.926938 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.927038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.927140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.927235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.927331 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.927426 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.927535 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.927633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.927729 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.927824 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.927925 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.928022 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.928129 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.928208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.928281 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.928351 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.928422 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.928493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.928600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.928681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.928847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.928925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.929091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.929170 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.929324 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.929403 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.929560 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.929639 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.929799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] resource.caching = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.929877 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.930035 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.930114 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.930281 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.930360 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.930794 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.930881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.931033 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.931113 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.931272 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.931351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.931506 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.931584 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.931750 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.931829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.931986 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.932064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.932221 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.932313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.932459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] role.caching = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.932547 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] resource.caching = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.932697 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] role.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.932817 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.932932 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.933046 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.933236 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.933354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.933469 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.933583 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.933698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.933810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.933933 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.934047 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.934161 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.934276 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.934390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.934504 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.934626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.934755 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.934872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] role.caching = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.934986 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.935099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] role.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.935213 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.935340 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.935457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.935570 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.935683 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.935797 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.935957 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.936141 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.936269 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.936387 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.936609 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.936811 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.936936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.937053 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.937168 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.937282 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.937398 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.937519 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.937643 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.937759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.937873 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.937986 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.938101 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.938214 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.938336 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.938454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.938568 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.938682 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.938835 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.938950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.939080 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.939195 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.939309 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.939423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.939538 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.939652 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.939774 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.939889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.940003 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.940117 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.940222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.940318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.940423 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.940538 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.940653 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.940767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.940881 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] token.caching = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.940995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.941118 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.941256 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.941374 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.941489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.941632 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.941822 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.941822 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.942161 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.942339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.942521 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.942521 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.942900 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.943085 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.943264 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.943453 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.943640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.943830 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.944032 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.944032 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.944354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.944545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] token.caching = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.944736 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.944924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.945127 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.945316 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.945497 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.945685 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.945879 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.946066 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.946269 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.946459 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.946649 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.946871 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.947059 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.947245 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.947440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.connection = **** {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.947635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.947846 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.948042 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.948230 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.948424 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.948612 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.948800 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.948998 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.949187 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.949375 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.949567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.949756 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.949942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.950149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.950333 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.950517 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.950700 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.951008 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.951128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.951259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.951420 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.connection = **** {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.952135 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.952135 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.952467 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.952585 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.952706 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.952830 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.952946 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.953061 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.953177 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.953291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.953406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.953529 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.953645 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.953761 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.953876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.953990 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 23:57:35.954105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.954105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.954105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.954105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.954105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.954105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.954105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.954105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.954105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.955071 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.955071 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:57:35.955071 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 23:57:35.979548 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:35.979781 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:35.980003 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:35.981562 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:35.981798 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:35.982026 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:35.988508 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:35.990927 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.018599 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.018857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.019437 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.019670 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.071286 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.071831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.122096 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.122341 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.124238 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.124646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.189031 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.189247 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.189465 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.189684 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.189901 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.190117 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.191619 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.191858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.192086 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.192307 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.192526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.192743 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.213825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.213948 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.214057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.214173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.214285 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.214395 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.214507 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.214625 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.214753 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.214852 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.215020 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.215164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.215264 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.215347 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.226191 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.226558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.239241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.239506 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.239693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.239778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.239910 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.239994 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.240123 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.240209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.240335 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.240420 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.240548 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87309) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.240633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.240823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.241040 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 23:57:36.258024 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.258232 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 23:57:36.258525 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.258627 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.258760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 23:57:36.258847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 23:57:36.259029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.259112 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.259285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.259383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 23:57:36.259543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.259647 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.259793 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.259881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.260047 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.260302 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.270187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.270462 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.270752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.270910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.271035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.271194 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.271465 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.271747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.279782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.280778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.282730 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.283008 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.283289 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.283572 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.283788 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.283872 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.284064 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.284148 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.284347 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.284429 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.284615 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.284700 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.284881 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.284964 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.285138 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.285228 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.285401 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.285483 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.285670 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.285957 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.286237 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.286510 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.308529 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.310020 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.310218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.310303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.312547 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.312820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.315448 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.315725 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.316006 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.317506 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.317790 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.318068 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.322671 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.322928 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.324726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.325012 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.327684 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.327967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.328259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.328543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.328825 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.329203 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.329484 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.329759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.329959 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.330244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.330526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.330837 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.331114 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.331494 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.331766 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.332036 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.345595 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.345867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.347935 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.348213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.349777 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.352059 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.352937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.353231 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.355172 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.355466 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.357614 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.360186 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.360852 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.363359 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.364013 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.364311 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.364595 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.364875 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.365255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.365535 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.366492 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.366811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.367097 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.367387 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.367666 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.368053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.382090 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.382370 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.382635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.382919 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.384943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.385225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.385490 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.385751 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.389929 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.391630 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.391902 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.393016 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.394597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.394680 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.394898 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.394984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.395183 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.395467 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.395740 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.397655 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.397933 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.398212 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.398499 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.398799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.407697 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.407969 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.408243 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.408519 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.408794 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.409063 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.409334 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.411202 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.411478 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.411753 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.412035 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.412311 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.412582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.412854 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.424986 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.427998 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.428738 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.432100 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.432229 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.433706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.435236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.435513 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.435790 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.436600 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.438364 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.439883 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.440159 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.440437 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.545979 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.547608 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.550484 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.550806 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.551092 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.551369 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.551450 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.552873 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.556025 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.556314 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.556598 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.556875 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.559614 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.559902 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.560182 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.565252 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.565542 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.565821 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.567273 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87309) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.567667 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.567960 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.568236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.568507 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.568786 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.569061 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.569344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.569614 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.569880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.570146 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.570409 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.570678 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.570962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87309) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.572664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 23:57:36.573099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.573348 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.573628 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.573905 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.574191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.574471 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.574774 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.575057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.575334 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.575604 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.575871 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.576138 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.576400 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 23:57:36.605413 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563f5d8a79c0 pid: 87309 (default app) Jul 25 23:57:36.609472 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367ef54-38ee-4428-8590-dbebf3b12c8d None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:36.609760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367ef54-38ee-4428-8590-dbebf3b12c8d None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:36.610038 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367ef54-38ee-4428-8590-dbebf3b12c8d None None] PATH_INFO: `/v3` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:36.611473 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563f5d8a79c0 pid: 87308 (default app) Jul 25 23:57:36.614163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Mon Jul 25 23:57:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:57:44.636252 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a90c0a-1b84-414a-ae1b-d9aeed001d3b None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:44.636900 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a90c0a-1b84-414a-ae1b-d9aeed001d3b None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:44.636900 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a90c0a-1b84-414a-ae1b-d9aeed001d3b None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:44.642601 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:57:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:57:44.648270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293ea15-4308-47ca-b6fe-5526b71cb57f None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:44.648708 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293ea15-4308-47ca-b6fe-5526b71cb57f None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:44.648896 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293ea15-4308-47ca-b6fe-5526b71cb57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:44.727974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: INFO dbcounter [None req-e293ea15-4308-47ca-b6fe-5526b71cb57f None None] Registered counter for database keystone Jul 25 23:57:44.750335 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG oslo_db.sqlalchemy.engines [None req-e293ea15-4308-47ca-b6fe-5526b71cb57f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 23:57:44.756432 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writer thread running {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 23:57:44.931270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG passlib.handlers.bcrypt [None req-e293ea15-4308-47ca-b6fe-5526b71cb57f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87309) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 23:57:44.931607 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG passlib.handlers.bcrypt [None req-e293ea15-4308-47ca-b6fe-5526b71cb57f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87309) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 23:57:44.987045 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-e293ea15-4308-47ca-b6fe-5526b71cb57f None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:57:44.988665 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-e293ea15-4308-47ca-b6fe-5526b71cb57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:57:45.112351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:57:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 23:57:45.245883 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a90c0a-1b84-414a-ae1b-d9aeed001d3b None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:45.322679 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: INFO dbcounter [None req-02a90c0a-1b84-414a-ae1b-d9aeed001d3b None None] Registered counter for database keystone Jul 25 23:57:45.342238 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG oslo_db.sqlalchemy.engines [None req-02a90c0a-1b84-414a-ae1b-d9aeed001d3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87308) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 23:57:45.348378 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writer thread running {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 23:57:45.468579 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a90c0a-1b84-414a-ae1b-d9aeed001d3b None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:45.472913 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f1f5b-c4c7-4e07-952d-83762fa369ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:45.473547 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1f5b-c4c7-4e07-952d-83762fa369ef admin admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:45.473830 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1f5b-c4c7-4e07-952d-83762fa369ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:45.474106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1f5b-c4c7-4e07-952d-83762fa369ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:45.482975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f1f5b-c4c7-4e07-952d-83762fa369ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:45.534562 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f49f1f5b-c4c7-4e07-952d-83762fa369ef admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 23:57:45.534879 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f1f5b-c4c7-4e07-952d-83762fa369ef admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:45.544278 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Jul 25 23:57:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:57:45.550875 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293ea15-4308-47ca-b6fe-5526b71cb57f None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:45.566026 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293ea15-4308-47ca-b6fe-5526b71cb57f None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:45.570440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd9d9e-9606-46a8-a202-5ed3bd6b51a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:45.571571 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd9d9e-9606-46a8-a202-5ed3bd6b51a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:45.571855 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd9d9e-9606-46a8-a202-5ed3bd6b51a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:45.572132 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd9d9e-9606-46a8-a202-5ed3bd6b51a9 admin admin] PATH_INFO: `/v3/projects/a89d9c4e1862458dba91de9a0e7a6b24` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:45.573614 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd9d9e-9606-46a8-a202-5ed3bd6b51a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=a89d9c4e1862458dba91de9a0e7a6b24)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:45.624255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: WARNING keystone.common.rbac_enforcer.enforcer [None req-32dd9d9e-9606-46a8-a202-5ed3bd6b51a9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 23:57:45.624594 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd9d9e-9606-46a8-a202-5ed3bd6b51a9 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:45.629183 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Jul 25 23:57:45 2022] GET /identity/v3/projects/a89d9c4e1862458dba91de9a0e7a6b24 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:57:47.807202 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecb9d2-a9b0-4e5e-b3e6-376acfd94249 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:47.807737 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecb9d2-a9b0-4e5e-b3e6-376acfd94249 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:47.807737 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecb9d2-a9b0-4e5e-b3e6-376acfd94249 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:47.812062 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:57:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:57:47.817292 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd835c0-ed28-4fff-8974-02ec6eb422aa None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:47.817688 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd835c0-ed28-4fff-8974-02ec6eb422aa None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:47.817847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd835c0-ed28-4fff-8974-02ec6eb422aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:47.838268 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-fdd835c0-ed28-4fff-8974-02ec6eb422aa None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:57:47.839797 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-fdd835c0-ed28-4fff-8974-02ec6eb422aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:57:47.848312 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:57:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 23:57:47.870489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecb9d2-a9b0-4e5e-b3e6-376acfd94249 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:47.882961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecb9d2-a9b0-4e5e-b3e6-376acfd94249 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:47.887228 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708a5d1-6e02-4fe0-bac7-06aadaca91bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:47.887830 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708a5d1-6e02-4fe0-bac7-06aadaca91bf admin admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:47.888117 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708a5d1-6e02-4fe0-bac7-06aadaca91bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:47.888952 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708a5d1-6e02-4fe0-bac7-06aadaca91bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:47.896780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708a5d1-6e02-4fe0-bac7-06aadaca91bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:47.898561 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708a5d1-6e02-4fe0-bac7-06aadaca91bf admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:47.907450 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Jul 25 23:57:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 23:57:47.912561 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd835c0-ed28-4fff-8974-02ec6eb422aa None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:47.921956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd835c0-ed28-4fff-8974-02ec6eb422aa None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:47.926323 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca673d8-3203-48a7-8526-4e81eda47ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:47.926976 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca673d8-3203-48a7-8526-4e81eda47ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:47.927257 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca673d8-3203-48a7-8526-4e81eda47ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:47.927531 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca673d8-3203-48a7-8526-4e81eda47ee8 admin admin] PATH_INFO: `/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:47.928880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca673d8-3203-48a7-8526-4e81eda47ee8 admin admin] RBAC: Authorizing `identity:get_user(user_id=4c1cfffdc2f44dac84acffeaa3f395e7)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:47.931007 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca673d8-3203-48a7-8526-4e81eda47ee8 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:47.932515 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Jul 25 23:57:47 2022] GET /identity/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:57:50.202781 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b78f6-e203-475d-95a0-8a2531ff18e3 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:50.203313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b78f6-e203-475d-95a0-8a2531ff18e3 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:50.203408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b78f6-e203-475d-95a0-8a2531ff18e3 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:50.204672 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:57:50.209834 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccdb45-2712-48d2-a6db-d2959785e936 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:50.210225 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccdb45-2712-48d2-a6db-d2959785e936 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:50.210398 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccdb45-2712-48d2-a6db-d2959785e936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:50.221172 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6758a9-48ca-4658-a848-952602d88360 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:50.221537 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6758a9-48ca-4658-a848-952602d88360 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:50.221824 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6758a9-48ca-4658-a848-952602d88360 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:50.223193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:57:50.228146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79366481-a525-47ab-b9c8-ff3cc2b69469 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:50.228439 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79366481-a525-47ab-b9c8-ff3cc2b69469 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:50.228721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79366481-a525-47ab-b9c8-ff3cc2b69469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:50.230121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-ffccdb45-2712-48d2-a6db-d2959785e936 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:57:50.231339 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-ffccdb45-2712-48d2-a6db-d2959785e936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:57:50.270881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG passlib.handlers.bcrypt [None req-79366481-a525-47ab-b9c8-ff3cc2b69469 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87308) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 23:57:50.271235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG passlib.handlers.bcrypt [None req-79366481-a525-47ab-b9c8-ff3cc2b69469 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87308) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 23:57:50.311604 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:57:50.317472 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-79366481-a525-47ab-b9c8-ff3cc2b69469 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:57:50.319112 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-79366481-a525-47ab-b9c8-ff3cc2b69469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:57:50.335192 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccdb45-2712-48d2-a6db-d2959785e936 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:50.359525 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:50.422363 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:57:50.439548 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccdb45-2712-48d2-a6db-d2959785e936 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:50.445106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79366481-a525-47ab-b9c8-ff3cc2b69469 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:50.473192 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93cb9-5e1e-4f32-8fe1-aafa3fb37d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:50.473835 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93cb9-5e1e-4f32-8fe1-aafa3fb37d9c None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:50.474121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93cb9-5e1e-4f32-8fe1-aafa3fb37d9c None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:50.474400 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac93cb9-5e1e-4f32-8fe1-aafa3fb37d9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:50.485429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac93cb9-5e1e-4f32-8fe1-aafa3fb37d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-3ac93cb9-5e1e-4f32-8fe1-aafa3fb37d9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:57:50.494079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:57:50.495236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:57:50.496250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:57:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:57:50.501504 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93cb9-5e1e-4f32-8fe1-aafa3fb37d9c None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:50.550101 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79366481-a525-47ab-b9c8-ff3cc2b69469 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:50.552419 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:50.583529 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:50.587974 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c177f4-21ca-4c61-8c5d-1189c522c7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:50.588868 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c177f4-21ca-4c61-8c5d-1189c522c7cf None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:50.589152 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c177f4-21ca-4c61-8c5d-1189c522c7cf None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:50.589424 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c177f4-21ca-4c61-8c5d-1189c522c7cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:50.602621 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac93cb9-5e1e-4f32-8fe1-aafa3fb37d9c None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:50.637286 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3074805-d2aa-43e6-b032-eda7044c76b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:50.637888 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074805-d2aa-43e6-b032-eda7044c76b6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:50.638187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074805-d2aa-43e6-b032-eda7044c76b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:50.639177 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074805-d2aa-43e6-b032-eda7044c76b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:50.639951 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3074805-d2aa-43e6-b032-eda7044c76b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:57:50.640261 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3074805-d2aa-43e6-b032-eda7044c76b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:50.641691 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3074805-d2aa-43e6-b032-eda7044c76b6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:50.653492 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:57:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:57:50.657626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c177f4-21ca-4c61-8c5d-1189c522c7cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:50.659263 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3074805-d2aa-43e6-b032-eda7044c76b6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:50.659385 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c177f4-21ca-4c61-8c5d-1189c522c7cf None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:50.757761 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 23:57:50.758663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3074805-d2aa-43e6-b032-eda7044c76b6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:50.763689 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c177f4-21ca-4c61-8c5d-1189c522c7cf None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:50.766388 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:50.792146 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e7a7d-bfb7-4f43-bd0a-ff82d6607ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:50.792789 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e7a7d-bfb7-4f43-bd0a-ff82d6607ce4 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:50.793069 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e7a7d-bfb7-4f43-bd0a-ff82d6607ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:50.793348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e7a7d-bfb7-4f43-bd0a-ff82d6607ce4 None admin] PATH_INFO: `/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:50.795128 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e7a7d-bfb7-4f43-bd0a-ff82d6607ce4 None admin] RBAC: Authorizing `identity:get_user(user_id=4c1cfffdc2f44dac84acffeaa3f395e7)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:50.796715 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e7a7d-bfb7-4f43-bd0a-ff82d6607ce4 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:50.798297 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:57:50 2022] GET /identity/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:57:50.803747 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e7a7d-bfb7-4f43-bd0a-ff82d6607ce4 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:50.818612 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:50.861832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c177f4-21ca-4c61-8c5d-1189c522c7cf None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:50.895895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7685f-8d0d-4d38-899b-208983da2aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:50.896742 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7685f-8d0d-4d38-899b-208983da2aba None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:50.897024 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7685f-8d0d-4d38-899b-208983da2aba None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:50.897304 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7685f-8d0d-4d38-899b-208983da2aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:50.900685 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e7a7d-bfb7-4f43-bd0a-ff82d6607ce4 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:50.917581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7685f-8d0d-4d38-899b-208983da2aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:50.919067 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7685f-8d0d-4d38-899b-208983da2aba None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:50.936193 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02d12e-b320-4505-a6bb-955ff835f855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:50.936928 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02d12e-b320-4505-a6bb-955ff835f855 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:50.937214 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02d12e-b320-4505-a6bb-955ff835f855 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:50.937490 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02d12e-b320-4505-a6bb-955ff835f855 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:50.938665 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02d12e-b320-4505-a6bb-955ff835f855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-b6e7685f-8d0d-4d38-899b-208983da2aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:57:50.938866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:57:50.939590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:57:50.940511 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:57:50.940511 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:57:50.940511 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:57:50.940511 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:57:50.940511 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 9/18] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:57:50.940768 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02d12e-b320-4505-a6bb-955ff835f855 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:50.946761 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 10/19] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:57:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:57:50.946896 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7685f-8d0d-4d38-899b-208983da2aba None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:50.947600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02d12e-b320-4505-a6bb-955ff835f855 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:51.007015 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:51.029062 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:51.049303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02d12e-b320-4505-a6bb-955ff835f855 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:51.054204 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7685f-8d0d-4d38-899b-208983da2aba None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:51.083389 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174305d-3d03-40b2-9900-9c14c3726391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:51.084008 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174305d-3d03-40b2-9900-9c14c3726391 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:51.084284 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174305d-3d03-40b2-9900-9c14c3726391 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:51.084559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174305d-3d03-40b2-9900-9c14c3726391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:51.085341 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174305d-3d03-40b2-9900-9c14c3726391 None admin] RBAC: Adding query filter params (role.id=5d947b934e0642c5a4ab00d547ec3fda, scope.domain.id=default, user.id=4c1cfffdc2f44dac84acffeaa3f395e7) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:57:51.085648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174305d-3d03-40b2-9900-9c14c3726391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:51.087154 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174305d-3d03-40b2-9900-9c14c3726391 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:51.088401 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e76433-9808-43df-930f-e8a7ef248da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:51.089012 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e76433-9808-43df-930f-e8a7ef248da9 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:51.089290 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e76433-9808-43df-930f-e8a7ef248da9 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:51.089563 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e76433-9808-43df-930f-e8a7ef248da9 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:51.090241 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e76433-9808-43df-930f-e8a7ef248da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:57:51.090543 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e76433-9808-43df-930f-e8a7ef248da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:51.092467 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e76433-9808-43df-930f-e8a7ef248da9 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:51.094394 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 11/20] 10.222.0.65 () {56 vars in 1322 bytes} [Mon Jul 25 23:57:50 2022] GET /identity/v3/role_assignments?user.id=4c1cfffdc2f44dac84acffeaa3f395e7&scope.domain.id=default&role.id=5d947b934e0642c5a4ab00d547ec3fda => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:57:51.111334 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 10/21] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:57:53.776820 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0ea8-d3f8-4e57-95a9-2e586a7062ba None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:53.777426 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0ea8-d3f8-4e57-95a9-2e586a7062ba None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:53.777426 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0ea8-d3f8-4e57-95a9-2e586a7062ba None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:53.778997 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 12/22] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:57:53.792366 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4021-0200-4e68-99e7-cab3c1ce95b6 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:53.793274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4021-0200-4e68-99e7-cab3c1ce95b6 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:53.793775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4021-0200-4e68-99e7-cab3c1ce95b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:53.820053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-93de4021-0200-4e68-99e7-cab3c1ce95b6 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:57:53.821562 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-93de4021-0200-4e68-99e7-cab3c1ce95b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:57:53.911022 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 11/23] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:57:53.948296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd0ea8-d3f8-4e57-95a9-2e586a7062ba None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:54.103972 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd0ea8-d3f8-4e57-95a9-2e586a7062ba None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:54.147480 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bcf2a-1b16-416d-bbea-e30a1a232567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:54.148145 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bcf2a-1b16-416d-bbea-e30a1a232567 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:54.148426 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bcf2a-1b16-416d-bbea-e30a1a232567 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:54.148700 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bcf2a-1b16-416d-bbea-e30a1a232567 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:54.165835 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bcf2a-1b16-416d-bbea-e30a1a232567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-6c5bcf2a-1b16-416d-bbea-e30a1a232567 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:57:54.171913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:57:54.172815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:57:54.173586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 13/24] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:57:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:57:54.179746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de4021-0200-4e68-99e7-cab3c1ce95b6 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:54.215416 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844a73b-7e11-4709-b8ff-841f5bda6523 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:54.215678 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844a73b-7e11-4709-b8ff-841f5bda6523 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:54.216143 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844a73b-7e11-4709-b8ff-841f5bda6523 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:54.218839 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 14/25] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:57:54.223985 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56562c63-2053-4661-8baf-59f8041f9d1b None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:54.224444 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56562c63-2053-4661-8baf-59f8041f9d1b None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:54.224868 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56562c63-2053-4661-8baf-59f8041f9d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:54.251081 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:54.253009 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-56562c63-2053-4661-8baf-59f8041f9d1b None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:57:54.254374 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-56562c63-2053-4661-8baf-59f8041f9d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:57:54.276119 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:54.364645 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 15/26] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:57:54.364645 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38ab9-a767-4ad6-b0d9-cc2b36380910 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:54.364645 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38ab9-a767-4ad6-b0d9-cc2b36380910 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:54.364645 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38ab9-a767-4ad6-b0d9-cc2b36380910 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:54.364645 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 16/27] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:57:54.368069 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc546031-1c9f-4384-b037-2ec7dec72e86 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:54.368971 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc546031-1c9f-4384-b037-2ec7dec72e86 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:54.370316 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc546031-1c9f-4384-b037-2ec7dec72e86 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:54.371929 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 17/28] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:57:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:57:54.378012 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf9eeb-2209-4e89-8f5d-c35b036f9a8b None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:54.378306 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf9eeb-2209-4e89-8f5d-c35b036f9a8b None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:54.378593 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf9eeb-2209-4e89-8f5d-c35b036f9a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:54.383482 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de4021-0200-4e68-99e7-cab3c1ce95b6 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:54.403238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-ceaf9eeb-2209-4e89-8f5d-c35b036f9a8b None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:57:54.406543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-ceaf9eeb-2209-4e89-8f5d-c35b036f9a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:57:54.432510 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadacaf2-5ac7-4e4d-9fbf-b0fc862c0fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:54.433711 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadacaf2-5ac7-4e4d-9fbf-b0fc862c0fa3 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:54.434144 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadacaf2-5ac7-4e4d-9fbf-b0fc862c0fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:54.435434 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadacaf2-5ac7-4e4d-9fbf-b0fc862c0fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:54.436223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadacaf2-5ac7-4e4d-9fbf-b0fc862c0fa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:57:54.437813 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadacaf2-5ac7-4e4d-9fbf-b0fc862c0fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:54.438931 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadacaf2-5ac7-4e4d-9fbf-b0fc862c0fa3 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:54.453674 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 12/29] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:57:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:57:54.459365 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8faf-52af-4b56-829b-f1101a1281de None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:54.459953 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8faf-52af-4b56-829b-f1101a1281de None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:54.460422 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8faf-52af-4b56-829b-f1101a1281de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:54.479827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-7fcd8faf-52af-4b56-829b-f1101a1281de None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:57:54.481436 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-7fcd8faf-52af-4b56-829b-f1101a1281de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:57:54.492855 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 18/30] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:57:54.493775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf9eeb-2209-4e89-8f5d-c35b036f9a8b None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:54.572734 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 13/31] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:57:54.573898 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8faf-52af-4b56-829b-f1101a1281de None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:54.577749 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:54.635339 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf9eeb-2209-4e89-8f5d-c35b036f9a8b None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:54.636271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:54.681449 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e326f2-7d5f-452f-930a-5a4a466d8dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:54.682746 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e326f2-7d5f-452f-930a-5a4a466d8dcf None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:54.683175 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e326f2-7d5f-452f-930a-5a4a466d8dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:54.683591 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e326f2-7d5f-452f-930a-5a4a466d8dcf None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:54.684799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e326f2-7d5f-452f-930a-5a4a466d8dcf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:54.687489 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e326f2-7d5f-452f-930a-5a4a466d8dcf None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:54.714098 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8faf-52af-4b56-829b-f1101a1281de None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:54.754096 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0e727-2285-40de-b078-00d121062408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:54.754974 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0e727-2285-40de-b078-00d121062408 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:54.755355 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0e727-2285-40de-b078-00d121062408 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:54.755744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0e727-2285-40de-b078-00d121062408 None admin] PATH_INFO: `/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:54.757423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0e727-2285-40de-b078-00d121062408 None admin] RBAC: Authorizing `identity:get_user(user_id=4c1cfffdc2f44dac84acffeaa3f395e7)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:54.759076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0e727-2285-40de-b078-00d121062408 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:54.760750 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 14/32] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:57:54 2022] GET /identity/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:57:54.761567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0e727-2285-40de-b078-00d121062408 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:54.854739 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 19/33] 10.222.0.65 () {60 vars in 1131 bytes} [Mon Jul 25 23:57:54 2022] POST /identity/v3/roles => generated 219 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:57:54.854739 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e326f2-7d5f-452f-930a-5a4a466d8dcf None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:54.950407 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0e727-2285-40de-b078-00d121062408 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:54.960268 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:54.984680 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e326f2-7d5f-452f-930a-5a4a466d8dcf None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:55.012487 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c950b53-dc52-4389-bb1f-9160dc616784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:55.013970 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c950b53-dc52-4389-bb1f-9160dc616784 None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:55.014877 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:55.015708 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c950b53-dc52-4389-bb1f-9160dc616784 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:55.015708 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c950b53-dc52-4389-bb1f-9160dc616784 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:55.016482 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c950b53-dc52-4389-bb1f-9160dc616784 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:55.018892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c950b53-dc52-4389-bb1f-9160dc616784 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:55.034647 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdf0d2-aa41-4404-968e-1266ace7eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:55.035660 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdf0d2-aa41-4404-968e-1266ace7eb73 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:55.035980 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdf0d2-aa41-4404-968e-1266ace7eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:55.036420 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdf0d2-aa41-4404-968e-1266ace7eb73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:55.053927 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdf0d2-aa41-4404-968e-1266ace7eb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:55.056404 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bdf0d2-aa41-4404-968e-1266ace7eb73 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-96bdf0d2-aa41-4404-968e-1266ace7eb73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:57:55.075000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:57:55.076087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:57:55.076885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:57:55.076885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:57:55.076885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:57:55.076885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:57:55.076885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 20/34] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:57:55.077971 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdf0d2-aa41-4404-968e-1266ace7eb73 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:55.164460 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 15/35] 10.222.0.65 () {60 vars in 1131 bytes} [Mon Jul 25 23:57:54 2022] POST /identity/v3/roles => generated 225 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:57:55.166326 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817502-32f0-4133-b8b6-fca77a809468 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:55.166678 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817502-32f0-4133-b8b6-fca77a809468 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:55.166990 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817502-32f0-4133-b8b6-fca77a809468 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:55.168855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 16/36] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:57:55.169454 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f817502-32f0-4133-b8b6-fca77a809468 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:55.204626 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdf0d2-aa41-4404-968e-1266ace7eb73 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:55.258003 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d6d04-adb4-4c8d-b6be-7e84294af731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:55.259490 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d6d04-adb4-4c8d-b6be-7e84294af731 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:55.259781 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d6d04-adb4-4c8d-b6be-7e84294af731 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:55.260063 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d6d04-adb4-4c8d-b6be-7e84294af731 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:55.262346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d6d04-adb4-4c8d-b6be-7e84294af731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:55.264467 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d6d04-adb4-4c8d-b6be-7e84294af731 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:55.267169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 21/37] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:57:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:57:55.268104 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0840682-072e-4941-9851-1b9925fcefa5 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:55.268399 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0840682-072e-4941-9851-1b9925fcefa5 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:55.268679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0840682-072e-4941-9851-1b9925fcefa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:55.290669 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-f0840682-072e-4941-9851-1b9925fcefa5 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:57:55.292456 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-f0840682-072e-4941-9851-1b9925fcefa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:57:55.311065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f817502-32f0-4133-b8b6-fca77a809468 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:55.344468 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:55.367065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350b5a6-d787-43a4-9fff-79ee779f00c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:55.367840 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350b5a6-d787-43a4-9fff-79ee779f00c3 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:55.368200 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350b5a6-d787-43a4-9fff-79ee779f00c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:55.368570 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350b5a6-d787-43a4-9fff-79ee779f00c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:55.369362 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350b5a6-d787-43a4-9fff-79ee779f00c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:57:55.369721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350b5a6-d787-43a4-9fff-79ee779f00c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:55.371344 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350b5a6-d787-43a4-9fff-79ee779f00c3 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:55.380930 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 22/38] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:57:55.382018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0840682-072e-4941-9851-1b9925fcefa5 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:55.386986 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 17/39] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:57:55.392933 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350b5a6-d787-43a4-9fff-79ee779f00c3 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:55.431168 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:55.517804 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350b5a6-d787-43a4-9fff-79ee779f00c3 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:55.521086 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0840682-072e-4941-9851-1b9925fcefa5 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:55.556515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109141e-eb96-4931-b193-1ef805840b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:55.557143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109141e-eb96-4931-b193-1ef805840b78 None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:55.557431 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109141e-eb96-4931-b193-1ef805840b78 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:55.557712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109141e-eb96-4931-b193-1ef805840b78 None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:55.558405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109141e-eb96-4931-b193-1ef805840b78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:55.559984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109141e-eb96-4931-b193-1ef805840b78 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:55.563564 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bc82b-c853-4511-ae62-6db09b338a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:55.564427 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bc82b-c853-4511-ae62-6db09b338a33 None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:55.565011 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bc82b-c853-4511-ae62-6db09b338a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:55.565449 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bc82b-c853-4511-ae62-6db09b338a33 None admin] PATH_INFO: `/v3/domains/default/users/4c1cfffdc2f44dac84acffeaa3f395e7/roles/5d947b934e0642c5a4ab00d547ec3fda` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:55.567996 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bc82b-c853-4511-ae62-6db09b338a33 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4c1cfffdc2f44dac84acffeaa3f395e7, role_id=5d947b934e0642c5a4ab00d547ec3fda)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:55.569633 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bc82b-c853-4511-ae62-6db09b338a33 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:55.587753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 23/40] 10.222.0.65 () {58 vars in 1361 bytes} [Mon Jul 25 23:57:55 2022] PUT /identity/v3/domains/default/users/4c1cfffdc2f44dac84acffeaa3f395e7/roles/5d947b934e0642c5a4ab00d547ec3fda => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:57:55.588323 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bc82b-c853-4511-ae62-6db09b338a33 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:55.596719 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 18/41] 10.222.0.65 () {60 vars in 1141 bytes} [Mon Jul 25 23:57:55 2022] POST /identity/v3/projects => generated 301 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:57:55.598105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff3cb-aebb-43d4-9bdb-bc51b081af42 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:55.598409 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff3cb-aebb-43d4-9bdb-bc51b081af42 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:55.598693 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff3cb-aebb-43d4-9bdb-bc51b081af42 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:55.600169 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 19/42] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:57:55.605691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63726cc-bee7-4ade-9270-cf6ce343a838 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:55.605989 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63726cc-bee7-4ade-9270-cf6ce343a838 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:55.606278 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63726cc-bee7-4ade-9270-cf6ce343a838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:55.626231 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-d63726cc-bee7-4ade-9270-cf6ce343a838 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:57:55.627891 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-d63726cc-bee7-4ade-9270-cf6ce343a838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:57:55.637052 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:55.705954 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 20/43] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:57:55.730543 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63726cc-bee7-4ade-9270-cf6ce343a838 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:55.742919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:55.743642 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bc82b-c853-4511-ae62-6db09b338a33 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:55.784972 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39004a44-3a11-496b-94c3-361828ea844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:55.785640 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39004a44-3a11-496b-94c3-361828ea844a None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:55.786001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39004a44-3a11-496b-94c3-361828ea844a None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:55.786349 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39004a44-3a11-496b-94c3-361828ea844a None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:55.787382 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39004a44-3a11-496b-94c3-361828ea844a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:55.789063 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39004a44-3a11-496b-94c3-361828ea844a None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:55.811863 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 24/44] 10.222.0.65 () {60 vars in 1131 bytes} [Mon Jul 25 23:57:55 2022] POST /identity/v3/roles => generated 223 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:57:55.870661 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63726cc-bee7-4ade-9270-cf6ce343a838 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:55.918121 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe55af9-2eb8-4b3f-98a8-1b8eceb930c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:55.919256 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe55af9-2eb8-4b3f-98a8-1b8eceb930c6 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:55.920206 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe55af9-2eb8-4b3f-98a8-1b8eceb930c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:55.920629 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe55af9-2eb8-4b3f-98a8-1b8eceb930c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:55.922087 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe55af9-2eb8-4b3f-98a8-1b8eceb930c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:55.923801 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe55af9-2eb8-4b3f-98a8-1b8eceb930c6 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:55.925960 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 21/45] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:57:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:57:55.932159 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39004a44-3a11-496b-94c3-361828ea844a None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:56.049793 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:56.057417 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39004a44-3a11-496b-94c3-361828ea844a None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:56.092752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16019638-59db-4e66-9b76-a7b55066b0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:56.093367 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16019638-59db-4e66-9b76-a7b55066b0a9 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:56.093649 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16019638-59db-4e66-9b76-a7b55066b0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:56.093923 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16019638-59db-4e66-9b76-a7b55066b0a9 None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:56.094610 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16019638-59db-4e66-9b76-a7b55066b0a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:56.096096 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16019638-59db-4e66-9b76-a7b55066b0a9 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:56.125608 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 25/46] 10.222.0.65 () {60 vars in 1141 bytes} [Mon Jul 25 23:57:55 2022] POST /identity/v3/projects => generated 312 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:57:57.922844 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e605fae-5bc1-4c66-bd8a-ea7fadec7661 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:57.923362 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e605fae-5bc1-4c66-bd8a-ea7fadec7661 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:57.923444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e605fae-5bc1-4c66-bd8a-ea7fadec7661 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:57.924782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 22/47] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:57:57.929927 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdefd6-20ca-4fa5-bf94-3b417d10ed42 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:57.930585 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdefd6-20ca-4fa5-bf94-3b417d10ed42 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:57.930788 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdefd6-20ca-4fa5-bf94-3b417d10ed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:57.949133 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-89cdefd6-20ca-4fa5-bf94-3b417d10ed42 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:57:57.950366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-89cdefd6-20ca-4fa5-bf94-3b417d10ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:57:58.024134 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 26/48] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:57:58.047347 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e605fae-5bc1-4c66-bd8a-ea7fadec7661 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:58.124706 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:58.149011 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e605fae-5bc1-4c66-bd8a-ea7fadec7661 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:58.182324 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92582f6e-5898-4a71-a70f-040e5dff0da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:58.182943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92582f6e-5898-4a71-a70f-040e5dff0da3 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:58.183233 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92582f6e-5898-4a71-a70f-040e5dff0da3 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:58.183514 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92582f6e-5898-4a71-a70f-040e5dff0da3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:58.197317 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92582f6e-5898-4a71-a70f-040e5dff0da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-92582f6e-5898-4a71-a70f-040e5dff0da3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:57:58.204862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:57:58.205795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:57:58.206544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 23/49] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:57:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:57:58.212266 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdefd6-20ca-4fa5-bf94-3b417d10ed42 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:58.294356 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:58.317852 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdefd6-20ca-4fa5-bf94-3b417d10ed42 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:58.347417 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcaa5c-ed75-4be5-973b-e41a03d45d6c None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:58.347706 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcaa5c-ed75-4be5-973b-e41a03d45d6c None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:58.347983 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcaa5c-ed75-4be5-973b-e41a03d45d6c None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:58.349455 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 24/50] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:57:58.352615 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb719477-6395-4914-a0eb-de7fe96523cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:58.353230 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb719477-6395-4914-a0eb-de7fe96523cf None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:58.353516 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb719477-6395-4914-a0eb-de7fe96523cf None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:58.353796 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb719477-6395-4914-a0eb-de7fe96523cf None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:58.354123 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de63fd-b0b3-47d6-96a5-6969a4da61e4 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:58.354410 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de63fd-b0b3-47d6-96a5-6969a4da61e4 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:58.354504 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb719477-6395-4914-a0eb-de7fe96523cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:57:58.354690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de63fd-b0b3-47d6-96a5-6969a4da61e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:58.354842 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb719477-6395-4914-a0eb-de7fe96523cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:58.356231 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb719477-6395-4914-a0eb-de7fe96523cf None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:58.364631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 27/51] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:57:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:57:58.370208 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb719477-6395-4914-a0eb-de7fe96523cf None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:58.373335 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-46de63fd-b0b3-47d6-96a5-6969a4da61e4 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:57:58.374518 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-46de63fd-b0b3-47d6-96a5-6969a4da61e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:57:58.440281 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 25/52] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:57:58.464525 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de63fd-b0b3-47d6-96a5-6969a4da61e4 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:58.469828 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb719477-6395-4914-a0eb-de7fe96523cf None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:58.503820 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18614101-5e09-48fe-9a9a-12b2c0daeac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:58.504463 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18614101-5e09-48fe-9a9a-12b2c0daeac4 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:58.505156 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18614101-5e09-48fe-9a9a-12b2c0daeac4 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:58.505438 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18614101-5e09-48fe-9a9a-12b2c0daeac4 None admin] PATH_INFO: `/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:58.506606 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18614101-5e09-48fe-9a9a-12b2c0daeac4 None admin] RBAC: Authorizing `identity:get_user(user_id=4c1cfffdc2f44dac84acffeaa3f395e7)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:58.508073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18614101-5e09-48fe-9a9a-12b2c0daeac4 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:58.509656 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 28/53] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:57:58 2022] GET /identity/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:57:58.515923 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18614101-5e09-48fe-9a9a-12b2c0daeac4 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:58.524862 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:58.531221 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:58.565589 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de63fd-b0b3-47d6-96a5-6969a4da61e4 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:58.599421 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9bb88-fbf6-4bcc-a8f0-e82b398a44cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:58.600048 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9bb88-fbf6-4bcc-a8f0-e82b398a44cb None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:58.600328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9bb88-fbf6-4bcc-a8f0-e82b398a44cb None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:58.600606 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9bb88-fbf6-4bcc-a8f0-e82b398a44cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:58.601737 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9bb88-fbf6-4bcc-a8f0-e82b398a44cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:58.603205 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9bb88-fbf6-4bcc-a8f0-e82b398a44cb None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:58.604752 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 26/54] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:57:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:57:58.610327 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9bb88-fbf6-4bcc-a8f0-e82b398a44cb None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:58.615858 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18614101-5e09-48fe-9a9a-12b2c0daeac4 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:58.651780 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcd6be-e80b-4a71-983a-2d6304388530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:58.652419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcd6be-e80b-4a71-983a-2d6304388530 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:58.652704 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcd6be-e80b-4a71-983a-2d6304388530 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:58.652982 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcd6be-e80b-4a71-983a-2d6304388530 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:58.654282 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcd6be-e80b-4a71-983a-2d6304388530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:58.655756 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcd6be-e80b-4a71-983a-2d6304388530 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:58.657328 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 29/55] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:57:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:57:58.663116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcd6be-e80b-4a71-983a-2d6304388530 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:57:58.718020 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9bb88-fbf6-4bcc-a8f0-e82b398a44cb None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:58.738475 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:58.752933 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb3176-0d73-4783-83c5-97a76d2be05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:58.753549 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb3176-0d73-4783-83c5-97a76d2be05e None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:58.753831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb3176-0d73-4783-83c5-97a76d2be05e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:58.754108 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb3176-0d73-4783-83c5-97a76d2be05e None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:58.754825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb3176-0d73-4783-83c5-97a76d2be05e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:58.756313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb3176-0d73-4783-83c5-97a76d2be05e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:58.761159 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:57:58.764589 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcd6be-e80b-4a71-983a-2d6304388530 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:57:58.784581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 27/56] 10.222.0.65 () {60 vars in 1140 bytes} [Mon Jul 25 23:57:58 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:57:58.800265 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d443332-82fe-4376-af61-da2f07fa7146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:57:58.801007 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d443332-82fe-4376-af61-da2f07fa7146 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:57:58.801368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d443332-82fe-4376-af61-da2f07fa7146 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:57:58.801721 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d443332-82fe-4376-af61-da2f07fa7146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:57:58.802619 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d443332-82fe-4376-af61-da2f07fa7146 None admin] RBAC: Adding query filter params (role.id=5d947b934e0642c5a4ab00d547ec3fda, scope.domain.id=default, user.id=4c1cfffdc2f44dac84acffeaa3f395e7) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:57:58.803038 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d443332-82fe-4376-af61-da2f07fa7146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:57:58.804605 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d443332-82fe-4376-af61-da2f07fa7146 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:57:58.812665 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 30/57] 10.222.0.65 () {56 vars in 1322 bytes} [Mon Jul 25 23:57:58 2022] GET /identity/v3/role_assignments?user.id=4c1cfffdc2f44dac84acffeaa3f395e7&scope.domain.id=default&role.id=5d947b934e0642c5a4ab00d547ec3fda => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:01.003558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e34e7-355a-43ad-bfb0-a259c5b20342 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:01.003958 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e34e7-355a-43ad-bfb0-a259c5b20342 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:01.004115 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e34e7-355a-43ad-bfb0-a259c5b20342 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:01.005451 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 28/58] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:01.010455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62bb7b-c8cf-423b-912e-ae208181a354 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:01.010832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62bb7b-c8cf-423b-912e-ae208181a354 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:01.011054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62bb7b-c8cf-423b-912e-ae208181a354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:01.029326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-2a62bb7b-c8cf-423b-912e-ae208181a354 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:01.030545 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-2a62bb7b-c8cf-423b-912e-ae208181a354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:01.095763 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 31/59] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:01.121053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e34e7-355a-43ad-bfb0-a259c5b20342 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:01.220914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e34e7-355a-43ad-bfb0-a259c5b20342 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:01.252772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b71b1-f52d-49d1-8c18-78db4b4538b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:01.253339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b71b1-f52d-49d1-8c18-78db4b4538b0 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:01.253622 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b71b1-f52d-49d1-8c18-78db4b4538b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:01.253895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b71b1-f52d-49d1-8c18-78db4b4538b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:01.255057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b71b1-f52d-49d1-8c18-78db4b4538b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:01.256498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b71b1-f52d-49d1-8c18-78db4b4538b0 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:01.258044 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 29/60] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:01.264185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62bb7b-c8cf-423b-912e-ae208181a354 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:01.327106 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:01.359162 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62bb7b-c8cf-423b-912e-ae208181a354 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:01.391640 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805ac77-4ec0-488b-aab4-80c67d91793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:01.392236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805ac77-4ec0-488b-aab4-80c67d91793f None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:01.392516 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805ac77-4ec0-488b-aab4-80c67d91793f None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:01.392789 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805ac77-4ec0-488b-aab4-80c67d91793f None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:01.393451 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805ac77-4ec0-488b-aab4-80c67d91793f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:01.394942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805ac77-4ec0-488b-aab4-80c67d91793f None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:01.420684 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 32/61] 10.222.0.65 () {60 vars in 1132 bytes} [Mon Jul 25 23:58:01 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:58:04.607955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87a2d2-9654-4925-8ae6-27b3e170fa2a None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:04.608965 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87a2d2-9654-4925-8ae6-27b3e170fa2a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:04.609707 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87a2d2-9654-4925-8ae6-27b3e170fa2a None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:04.611953 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 30/62] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:04.617142 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446aac7-dd76-4839-8cc6-c5283ac452eb None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:04.618039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446aac7-dd76-4839-8cc6-c5283ac452eb None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:04.618518 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446aac7-dd76-4839-8cc6-c5283ac452eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:04.644561 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-2446aac7-dd76-4839-8cc6-c5283ac452eb None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:04.646073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-2446aac7-dd76-4839-8cc6-c5283ac452eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:04.737313 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 33/63] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:04.773538 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87a2d2-9654-4925-8ae6-27b3e170fa2a None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:04.852392 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:04.903974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60703-4a4e-40ae-9845-1802d6b08106 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:04.904257 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60703-4a4e-40ae-9845-1802d6b08106 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:04.904449 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60703-4a4e-40ae-9845-1802d6b08106 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:04.905788 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 34/64] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:04.910982 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28819f37-e4e3-4ace-ad91-1b729bfcd883 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:04.911270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28819f37-e4e3-4ace-ad91-1b729bfcd883 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:04.911546 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28819f37-e4e3-4ace-ad91-1b729bfcd883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:04.930768 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87a2d2-9654-4925-8ae6-27b3e170fa2a None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:04.936863 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-28819f37-e4e3-4ace-ad91-1b729bfcd883 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:04.938739 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-28819f37-e4e3-4ace-ad91-1b729bfcd883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:04.994224 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58e5f-56f7-4e4f-a47d-2bc7c0176964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:04.994903 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58e5f-56f7-4e4f-a47d-2bc7c0176964 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:04.995185 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58e5f-56f7-4e4f-a47d-2bc7c0176964 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:04.995457 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f58e5f-56f7-4e4f-a47d-2bc7c0176964 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.009030 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f58e5f-56f7-4e4f-a47d-2bc7c0176964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-29f58e5f-56f7-4e4f-a47d-2bc7c0176964 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:05.014925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:05.016354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:05.017444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:05.017444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:05.017444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:05.017444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:05.017444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:05.017444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:05.017444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:05.017444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:05.017444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:05.017444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:05.017444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:05.017444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:05.019839 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 31/65] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:05.026769 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58e5f-56f7-4e4f-a47d-2bc7c0176964 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:05.036455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:05.059698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 35/66] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 25 23:58:05.103659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28819f37-e4e3-4ace-ad91-1b729bfcd883 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:05.174118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f58e5f-56f7-4e4f-a47d-2bc7c0176964 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:05.201426 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:05.217995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa44fef-7d61-4a97-8939-9fb09a396ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:05.219080 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa44fef-7d61-4a97-8939-9fb09a396ef1 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.219502 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa44fef-7d61-4a97-8939-9fb09a396ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.219919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa44fef-7d61-4a97-8939-9fb09a396ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.220782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa44fef-7d61-4a97-8939-9fb09a396ef1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:05.221334 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa44fef-7d61-4a97-8939-9fb09a396ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:05.223137 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa44fef-7d61-4a97-8939-9fb09a396ef1 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:05.232674 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 32/67] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:05.238737 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96e01-4cf8-4282-92ad-e016239b424f None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.239409 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96e01-4cf8-4282-92ad-e016239b424f None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.239886 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96e01-4cf8-4282-92ad-e016239b424f None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.241498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 33/68] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:05.243329 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d96e01-4cf8-4282-92ad-e016239b424f None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:05.266104 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28819f37-e4e3-4ace-ad91-1b729bfcd883 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:05.304126 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87139ba4-2616-443a-818a-e20b0cf9b8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:05.304837 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87139ba4-2616-443a-818a-e20b0cf9b8f0 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.305380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87139ba4-2616-443a-818a-e20b0cf9b8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.305658 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87139ba4-2616-443a-818a-e20b0cf9b8f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.319696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87139ba4-2616-443a-818a-e20b0cf9b8f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-87139ba4-2616-443a-818a-e20b0cf9b8f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:05.326440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:05.327320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:05.328097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 36/69] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:58:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:05.329450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12884730-5d3f-4e00-85fb-2bb8f21e28c0 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.329888 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12884730-5d3f-4e00-85fb-2bb8f21e28c0 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.330301 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12884730-5d3f-4e00-85fb-2bb8f21e28c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.351831 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-12884730-5d3f-4e00-85fb-2bb8f21e28c0 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:05.353254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-12884730-5d3f-4e00-85fb-2bb8f21e28c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:05.368618 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d96e01-4cf8-4282-92ad-e016239b424f None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:05.409988 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448742-3f68-4e14-b026-20494e8bea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:05.410681 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:05.411981 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448742-3f68-4e14-b026-20494e8bea57 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.412462 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448742-3f68-4e14-b026-20494e8bea57 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.413296 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448742-3f68-4e14-b026-20494e8bea57 None admin] PATH_INFO: `/v3/users/daabac9b68d84dcdb04232880864f2ca` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.431740 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c448742-3f68-4e14-b026-20494e8bea57 None admin] RBAC: Authorizing `identity:get_user(user_id=daabac9b68d84dcdb04232880864f2ca)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:05.433608 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c448742-3f68-4e14-b026-20494e8bea57 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:05.435753 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 34/70] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:05 2022] GET /identity/v3/users/daabac9b68d84dcdb04232880864f2ca => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:05.442350 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448742-3f68-4e14-b026-20494e8bea57 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:05.443937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 37/71] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:05.444990 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12884730-5d3f-4e00-85fb-2bb8f21e28c0 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:05.496424 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:05.555264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12884730-5d3f-4e00-85fb-2bb8f21e28c0 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:05.570187 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448742-3f68-4e14-b026-20494e8bea57 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:05.598116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edc3db-d2ee-4b9f-9dd3-4be4ea8df968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:05.599162 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc3db-d2ee-4b9f-9dd3-4be4ea8df968 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.599721 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc3db-d2ee-4b9f-9dd3-4be4ea8df968 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.600039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc3db-d2ee-4b9f-9dd3-4be4ea8df968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.606837 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5720e4f-3fc5-4959-aee3-2b05335f4789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:05.607465 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5720e4f-3fc5-4959-aee3-2b05335f4789 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.607753 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5720e4f-3fc5-4959-aee3-2b05335f4789 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.608031 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5720e4f-3fc5-4959-aee3-2b05335f4789 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.608742 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5720e4f-3fc5-4959-aee3-2b05335f4789 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:05.609052 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5720e4f-3fc5-4959-aee3-2b05335f4789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:05.610492 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5720e4f-3fc5-4959-aee3-2b05335f4789 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:05.619789 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 35/72] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:05.620597 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5720e4f-3fc5-4959-aee3-2b05335f4789 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:05.651756 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:05.678248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edc3db-d2ee-4b9f-9dd3-4be4ea8df968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:05.679802 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edc3db-d2ee-4b9f-9dd3-4be4ea8df968 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:05.720628 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:05.726975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5720e4f-3fc5-4959-aee3-2b05335f4789 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:05.759791 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09508e00-c393-4638-82de-984c1ccdd7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:05.760424 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508e00-c393-4638-82de-984c1ccdd7f9 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.760708 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508e00-c393-4638-82de-984c1ccdd7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.760984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508e00-c393-4638-82de-984c1ccdd7f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.771535 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09508e00-c393-4638-82de-984c1ccdd7f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-09508e00-c393-4638-82de-984c1ccdd7f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:05.776895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:05.777906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:05.778934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:58:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:05.779732 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76728d-e5af-477d-9aec-daa2acb64937 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.779732 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76728d-e5af-477d-9aec-daa2acb64937 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.779843 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76728d-e5af-477d-9aec-daa2acb64937 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.780995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 37/74] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:05.785972 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76728d-e5af-477d-9aec-daa2acb64937 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:05.786078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 38/75] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:05.789107 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9168eb-e841-44ab-ae90-2677de14da1b None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.789422 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9168eb-e841-44ab-ae90-2677de14da1b None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.789759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9168eb-e841-44ab-ae90-2677de14da1b None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.791450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 39/76] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:05.794813 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9168eb-e841-44ab-ae90-2677de14da1b None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:05.866328 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:05.886069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76728d-e5af-477d-9aec-daa2acb64937 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:05.892937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9168eb-e841-44ab-ae90-2677de14da1b None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:05.919141 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410f067-f4e6-4758-9d27-f028e9c53d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:05.919770 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410f067-f4e6-4758-9d27-f028e9c53d4f None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.920050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410f067-f4e6-4758-9d27-f028e9c53d4f None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.920323 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410f067-f4e6-4758-9d27-f028e9c53d4f None admin] PATH_INFO: `/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.921472 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410f067-f4e6-4758-9d27-f028e9c53d4f None admin] RBAC: Authorizing `identity:get_user(user_id=4c1cfffdc2f44dac84acffeaa3f395e7)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:05.923150 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410f067-f4e6-4758-9d27-f028e9c53d4f None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:05.924716 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 38/77] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:05 2022] GET /identity/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:05.924716 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c685c-00ef-4329-8549-5e2e4305e973 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.924716 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c685c-00ef-4329-8549-5e2e4305e973 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.924716 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c685c-00ef-4329-8549-5e2e4305e973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.931376 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17ff68-dadd-4e6a-8d59-952d18124345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:05.931997 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17ff68-dadd-4e6a-8d59-952d18124345 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:05.932287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17ff68-dadd-4e6a-8d59-952d18124345 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:05.932557 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17ff68-dadd-4e6a-8d59-952d18124345 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:05.933270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17ff68-dadd-4e6a-8d59-952d18124345 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:05.933578 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17ff68-dadd-4e6a-8d59-952d18124345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:05.935003 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17ff68-dadd-4e6a-8d59-952d18124345 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:05.943585 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 40/78] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:58:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:05.944236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17ff68-dadd-4e6a-8d59-952d18124345 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:05.944799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-026c685c-00ef-4329-8549-5e2e4305e973 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:05.945977 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-026c685c-00ef-4329-8549-5e2e4305e973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:05.966519 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:06.017144 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 39/79] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:06.018530 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b764ca-cb88-494c-9140-84bb554dd22a None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:06.018926 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b764ca-cb88-494c-9140-84bb554dd22a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:06.019211 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b764ca-cb88-494c-9140-84bb554dd22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:06.037356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-01b764ca-cb88-494c-9140-84bb554dd22a None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:06.038573 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-01b764ca-cb88-494c-9140-84bb554dd22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:06.054049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17ff68-dadd-4e6a-8d59-952d18124345 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:06.088266 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a40da6-7864-4239-b50f-fe3cb6317bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:06.088918 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a40da6-7864-4239-b50f-fe3cb6317bb4 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:06.089204 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a40da6-7864-4239-b50f-fe3cb6317bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:06.089493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a40da6-7864-4239-b50f-fe3cb6317bb4 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:06.090654 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a40da6-7864-4239-b50f-fe3cb6317bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:06.092131 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a40da6-7864-4239-b50f-fe3cb6317bb4 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:06.094366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 41/80] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:05 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:06.095176 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a40da6-7864-4239-b50f-fe3cb6317bb4 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:06.102440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:06.112045 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 40/81] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:06.115643 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b764ca-cb88-494c-9140-84bb554dd22a None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:06.199984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:06.201224 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a40da6-7864-4239-b50f-fe3cb6317bb4 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:06.217017 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b764ca-cb88-494c-9140-84bb554dd22a None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:06.237784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8ae14-4d55-4c01-82f3-0440d1b3430e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:06.238341 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8ae14-4d55-4c01-82f3-0440d1b3430e None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:06.238629 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8ae14-4d55-4c01-82f3-0440d1b3430e None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:06.239357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8ae14-4d55-4c01-82f3-0440d1b3430e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:06.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbde8e-9528-466a-af35-f7c4c7b0e7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:06.253130 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbde8e-9528-466a-af35-f7c4c7b0e7a8 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:06.253416 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbde8e-9528-466a-af35-f7c4c7b0e7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:06.253699 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbde8e-9528-466a-af35-f7c4c7b0e7a8 None admin] PATH_INFO: `/v3/users/daabac9b68d84dcdb04232880864f2ca` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:06.254903 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbde8e-9528-466a-af35-f7c4c7b0e7a8 None admin] RBAC: Authorizing `identity:get_user(user_id=daabac9b68d84dcdb04232880864f2ca)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:06.256396 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbde8e-9528-466a-af35-f7c4c7b0e7a8 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:06.258006 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 41/82] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:06 2022] GET /identity/v3/users/daabac9b68d84dcdb04232880864f2ca => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:06.259614 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbde8e-9528-466a-af35-f7c4c7b0e7a8 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:06.308905 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8ae14-4d55-4c01-82f3-0440d1b3430e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:06.310361 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8ae14-4d55-4c01-82f3-0440d1b3430e None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:06.313293 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:06.358471 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbde8e-9528-466a-af35-f7c4c7b0e7a8 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:06.393531 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8bd9a-411c-4d66-acd8-dfa81f5b8e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:06.394245 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8bd9a-411c-4d66-acd8-dfa81f5b8e72 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:06.394530 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8bd9a-411c-4d66-acd8-dfa81f5b8e72 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:06.394834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8bd9a-411c-4d66-acd8-dfa81f5b8e72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:06.405234 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8bd9a-411c-4d66-acd8-dfa81f5b8e72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:06.408758 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 42/83] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:06.409589 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8ae14-4d55-4c01-82f3-0440d1b3430e None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-fcf8bd9a-411c-4d66-acd8-dfa81f5b8e72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:06.410338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:06.411178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:06.411919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 42/84] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:06.412532 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8bd9a-411c-4d66-acd8-dfa81f5b8e72 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:06.429255 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:06.509041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8ae14-4d55-4c01-82f3-0440d1b3430e None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:06.511365 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:06.513079 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8bd9a-411c-4d66-acd8-dfa81f5b8e72 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:06.543132 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11360f1f-311d-48aa-9cf6-4abc7719f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:06.543748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11360f1f-311d-48aa-9cf6-4abc7719f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:06.544036 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11360f1f-311d-48aa-9cf6-4abc7719f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:06.544313 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11360f1f-311d-48aa-9cf6-4abc7719f6f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:06.545091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11360f1f-311d-48aa-9cf6-4abc7719f6f0 None admin] RBAC: Adding query filter params (role.id=5717836a50094587b879206794e7156a, scope.project.id=c21bfcd3302f46909780c42e4b2d702d, user.id=daabac9b68d84dcdb04232880864f2ca) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:06.545404 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11360f1f-311d-48aa-9cf6-4abc7719f6f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:06.545948 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9bfcf-3583-4d14-a13c-bd612151e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:06.546576 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9bfcf-3583-4d14-a13c-bd612151e67c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:06.547522 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11360f1f-311d-48aa-9cf6-4abc7719f6f0 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:06.547618 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9bfcf-3583-4d14-a13c-bd612151e67c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:06.547842 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9bfcf-3583-4d14-a13c-bd612151e67c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:06.548990 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9bfcf-3583-4d14-a13c-bd612151e67c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:06.550412 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9bfcf-3583-4d14-a13c-bd612151e67c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:06.552010 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 43/85] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:06.566334 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 43/86] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:06 2022] GET /identity/v3/role_assignments?user.id=daabac9b68d84dcdb04232880864f2ca&scope.project.id=c21bfcd3302f46909780c42e4b2d702d&role.id=5717836a50094587b879206794e7156a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:06.566334 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11360f1f-311d-48aa-9cf6-4abc7719f6f0 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:06.566615 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9bfcf-3583-4d14-a13c-bd612151e67c None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:06.653190 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:06.674804 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9bfcf-3583-4d14-a13c-bd612151e67c None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:06.680341 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11360f1f-311d-48aa-9cf6-4abc7719f6f0 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:06.712972 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cad1ef-0ac1-4f8a-9d9b-fa44f72739b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:06.713718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cad1ef-0ac1-4f8a-9d9b-fa44f72739b7 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:06.714000 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cad1ef-0ac1-4f8a-9d9b-fa44f72739b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:06.714379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cad1ef-0ac1-4f8a-9d9b-fa44f72739b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:06.719753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f865cf-a2bc-4380-aa93-57ff3a439188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:06.720294 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f865cf-a2bc-4380-aa93-57ff3a439188 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:06.720570 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f865cf-a2bc-4380-aa93-57ff3a439188 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:06.720849 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f865cf-a2bc-4380-aa93-57ff3a439188 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:06.722057 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f865cf-a2bc-4380-aa93-57ff3a439188 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:06.723563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f865cf-a2bc-4380-aa93-57ff3a439188 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:06.725516 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 44/87] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:06 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:06.726045 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f865cf-a2bc-4380-aa93-57ff3a439188 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:06.771395 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:06.799240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cad1ef-0ac1-4f8a-9d9b-fa44f72739b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:06.800738 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cad1ef-0ac1-4f8a-9d9b-fa44f72739b7 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:06.843479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f865cf-a2bc-4380-aa93-57ff3a439188 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:06.881652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f799f-2067-4b02-8c06-4cb1195c1b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:06.882280 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f799f-2067-4b02-8c06-4cb1195c1b30 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:06.882569 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f799f-2067-4b02-8c06-4cb1195c1b30 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:06.882885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f799f-2067-4b02-8c06-4cb1195c1b30 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:06.883504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:06.884424 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f799f-2067-4b02-8c06-4cb1195c1b30 None admin] RBAC: Adding query filter params (name=member) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:06.884830 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f799f-2067-4b02-8c06-4cb1195c1b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:06.886131 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f799f-2067-4b02-8c06-4cb1195c1b30 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:06.894561 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 45/88] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:06.899924 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f799f-2067-4b02-8c06-4cb1195c1b30 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:06.907614 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 44/89] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:06.914910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cad1ef-0ac1-4f8a-9d9b-fa44f72739b7 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:07.005401 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:07.010329 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f799f-2067-4b02-8c06-4cb1195c1b30 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:07.027914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cad1ef-0ac1-4f8a-9d9b-fa44f72739b7 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:07.051143 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7809a5e-23e5-45f6-a185-f8b3211fe7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:07.051851 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7809a5e-23e5-45f6-a185-f8b3211fe7c3 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:07.052114 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7809a5e-23e5-45f6-a185-f8b3211fe7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:07.052377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7809a5e-23e5-45f6-a185-f8b3211fe7c3 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:07.053072 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7809a5e-23e5-45f6-a185-f8b3211fe7c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:07.054523 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7809a5e-23e5-45f6-a185-f8b3211fe7c3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:07.066486 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3984e-a99c-495b-8071-540581c605d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:07.067651 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3984e-a99c-495b-8071-540581c605d8 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:07.067980 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3984e-a99c-495b-8071-540581c605d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:07.068334 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3984e-a99c-495b-8071-540581c605d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:07.069217 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3984e-a99c-495b-8071-540581c605d8 None admin] RBAC: Adding query filter params (role.id=5d947b934e0642c5a4ab00d547ec3fda, scope.project.id=c21bfcd3302f46909780c42e4b2d702d, user.id=4c1cfffdc2f44dac84acffeaa3f395e7) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:07.069574 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3984e-a99c-495b-8071-540581c605d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:07.071420 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3984e-a99c-495b-8071-540581c605d8 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:07.078807 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 46/90] 10.222.0.65 () {60 vars in 1132 bytes} [Mon Jul 25 23:58:06 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:58:07.079637 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7809a5e-23e5-45f6-a185-f8b3211fe7c3 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:07.089089 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 45/91] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:06 2022] GET /identity/v3/role_assignments?user.id=4c1cfffdc2f44dac84acffeaa3f395e7&scope.project.id=c21bfcd3302f46909780c42e4b2d702d&role.id=5d947b934e0642c5a4ab00d547ec3fda => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:07.093031 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3984e-a99c-495b-8071-540581c605d8 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:07.169611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:07.198732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7809a5e-23e5-45f6-a185-f8b3211fe7c3 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:07.251669 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b886e6-5c1a-47d1-9192-6e678cac1ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:07.252384 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b886e6-5c1a-47d1-9192-6e678cac1ace None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:07.252672 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b886e6-5c1a-47d1-9192-6e678cac1ace None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:07.252953 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b886e6-5c1a-47d1-9192-6e678cac1ace None admin] PATH_INFO: `/v3/users/daabac9b68d84dcdb04232880864f2ca` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:07.254227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b886e6-5c1a-47d1-9192-6e678cac1ace None admin] RBAC: Authorizing `identity:get_user(user_id=daabac9b68d84dcdb04232880864f2ca)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:07.257910 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b886e6-5c1a-47d1-9192-6e678cac1ace None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:07.257910 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 47/92] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:07 2022] GET /identity/v3/users/daabac9b68d84dcdb04232880864f2ca => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:07.263593 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b886e6-5c1a-47d1-9192-6e678cac1ace None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:07.291954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:07.296487 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3984e-a99c-495b-8071-540581c605d8 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:07.380781 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba991b2-bee7-4541-ba98-b53160f531e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:07.381729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba991b2-bee7-4541-ba98-b53160f531e1 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:07.382046 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba991b2-bee7-4541-ba98-b53160f531e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:07.382809 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba991b2-bee7-4541-ba98-b53160f531e1 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:07.384359 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba991b2-bee7-4541-ba98-b53160f531e1 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:07.385461 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b886e6-5c1a-47d1-9192-6e678cac1ace None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:07.385841 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba991b2-bee7-4541-ba98-b53160f531e1 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:07.387852 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 46/93] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:07 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:07.394959 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba991b2-bee7-4541-ba98-b53160f531e1 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:07.456862 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c4a17-54ea-4693-bff2-c2b0dc78c77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:07.457499 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c4a17-54ea-4693-bff2-c2b0dc78c77d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:07.457789 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c4a17-54ea-4693-bff2-c2b0dc78c77d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:07.458074 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c4a17-54ea-4693-bff2-c2b0dc78c77d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:07.548193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba991b2-bee7-4541-ba98-b53160f531e1 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:07.550271 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c4a17-54ea-4693-bff2-c2b0dc78c77d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:07.552911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c4a17-54ea-4693-bff2-c2b0dc78c77d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:07.565485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:07.585421 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:07.598019 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db905b2e-27e9-408f-a768-4a5e96655f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:07.599065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db905b2e-27e9-408f-a768-4a5e96655f84 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:07.599430 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db905b2e-27e9-408f-a768-4a5e96655f84 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:07.600557 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db905b2e-27e9-408f-a768-4a5e96655f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:07.600667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db905b2e-27e9-408f-a768-4a5e96655f84 None admin] RBAC: Adding query filter params (role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa, scope.project.id=c21bfcd3302f46909780c42e4b2d702d, user.id=daabac9b68d84dcdb04232880864f2ca) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:07.601054 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db905b2e-27e9-408f-a768-4a5e96655f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:07.602594 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db905b2e-27e9-408f-a768-4a5e96655f84 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:07.618744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 47/94] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:07 2022] GET /identity/v3/role_assignments?user.id=daabac9b68d84dcdb04232880864f2ca&scope.project.id=c21bfcd3302f46909780c42e4b2d702d&role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:07.691570 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 48/95] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 23:58:07.696984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db905b2e-27e9-408f-a768-4a5e96655f84 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:07.815001 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db905b2e-27e9-408f-a768-4a5e96655f84 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:07.854829 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dc8bf-33c3-400f-a00e-12d4593f75f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:07.855854 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dc8bf-33c3-400f-a00e-12d4593f75f5 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:07.856369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dc8bf-33c3-400f-a00e-12d4593f75f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:07.856860 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dc8bf-33c3-400f-a00e-12d4593f75f5 None admin] PATH_INFO: `/v3/projects/7b99b0c6154d4d97952c718a174ed6d1` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:07.858290 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0dc8bf-33c3-400f-a00e-12d4593f75f5 None admin] RBAC: Authorizing `identity:get_project(project_id=7b99b0c6154d4d97952c718a174ed6d1)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:07.860913 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0dc8bf-33c3-400f-a00e-12d4593f75f5 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:07.862904 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 48/96] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:07 2022] GET /identity/v3/projects/7b99b0c6154d4d97952c718a174ed6d1 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:07.871156 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c4a17-54ea-4693-bff2-c2b0dc78c77d None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:07.985049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c4a17-54ea-4693-bff2-c2b0dc78c77d None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:08.011009 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:08.023576 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6aa99-9657-442b-85c9-753d0a0a2c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:08.024210 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6aa99-9657-442b-85c9-753d0a0a2c8a None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:08.024501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6aa99-9657-442b-85c9-753d0a0a2c8a None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:08.024782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6aa99-9657-442b-85c9-753d0a0a2c8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:08.025577 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6aa99-9657-442b-85c9-753d0a0a2c8a None admin] RBAC: Adding query filter params (role.id=5717836a50094587b879206794e7156a, scope.project.id=7b99b0c6154d4d97952c718a174ed6d1, user.id=daabac9b68d84dcdb04232880864f2ca) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:08.025892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6aa99-9657-442b-85c9-753d0a0a2c8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:08.027395 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6aa99-9657-442b-85c9-753d0a0a2c8a None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:08.033934 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 49/97] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:07 2022] GET /identity/v3/role_assignments?user.id=daabac9b68d84dcdb04232880864f2ca&scope.project.id=7b99b0c6154d4d97952c718a174ed6d1&role.id=5717836a50094587b879206794e7156a => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:09.056960 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44ee94-49e2-4932-b14c-7b1227822b67 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:09.057455 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44ee94-49e2-4932-b14c-7b1227822b67 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:09.057528 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44ee94-49e2-4932-b14c-7b1227822b67 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:09.059041 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 49/98] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:09.071109 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128d1b6-d941-463c-89e5-5b14e9100666 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:09.071521 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128d1b6-d941-463c-89e5-5b14e9100666 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:09.071694 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128d1b6-d941-463c-89e5-5b14e9100666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:09.095038 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-c128d1b6-d941-463c-89e5-5b14e9100666 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:09.096237 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-c128d1b6-d941-463c-89e5-5b14e9100666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:09.197035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 50/99] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:09.236949 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44ee94-49e2-4932-b14c-7b1227822b67 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:09.332348 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:09.416367 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44ee94-49e2-4932-b14c-7b1227822b67 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:09.462175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941636cd-72f7-4f9d-a077-56b32036dda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:09.462851 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941636cd-72f7-4f9d-a077-56b32036dda8 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:09.463135 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941636cd-72f7-4f9d-a077-56b32036dda8 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:09.463415 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941636cd-72f7-4f9d-a077-56b32036dda8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:09.476131 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941636cd-72f7-4f9d-a077-56b32036dda8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-941636cd-72f7-4f9d-a077-56b32036dda8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:09.481167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:09.481975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:09.482754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 50/100] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:09.491951 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128d1b6-d941-463c-89e5-5b14e9100666 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:09.654430 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128d1b6-d941-463c-89e5-5b14e9100666 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:09.675721 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:09.700928 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f2511-75b8-4258-88c3-69ed31ded48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:09.701566 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f2511-75b8-4258-88c3-69ed31ded48e None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:09.701856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f2511-75b8-4258-88c3-69ed31ded48e None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:09.702135 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f2511-75b8-4258-88c3-69ed31ded48e None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:09.703423 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f2511-75b8-4258-88c3-69ed31ded48e None admin] RBAC: Adding query filter params (name=member) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:09.703737 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f2511-75b8-4258-88c3-69ed31ded48e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:09.705140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f2511-75b8-4258-88c3-69ed31ded48e None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:09.718339 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 51/101] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:09.723924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941636cd-72f7-4f9d-a077-56b32036dda8 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:09.863680 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941636cd-72f7-4f9d-a077-56b32036dda8 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:09.871725 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:09.909180 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989aa765-b498-4a56-a1d8-849b4c57cf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:09.909750 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989aa765-b498-4a56-a1d8-849b4c57cf52 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:09.910039 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989aa765-b498-4a56-a1d8-849b4c57cf52 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:09.910314 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989aa765-b498-4a56-a1d8-849b4c57cf52 None admin] PATH_INFO: `/v3/users/daabac9b68d84dcdb04232880864f2ca` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:09.911585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989aa765-b498-4a56-a1d8-849b4c57cf52 None admin] RBAC: Authorizing `identity:get_user(user_id=daabac9b68d84dcdb04232880864f2ca)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:09.913062 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989aa765-b498-4a56-a1d8-849b4c57cf52 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:09.915070 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 51/102] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:09 2022] GET /identity/v3/users/daabac9b68d84dcdb04232880864f2ca => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:09.920713 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f2511-75b8-4258-88c3-69ed31ded48e None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:10.012782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546bf80-4083-472a-872e-6b3da96419f6 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:10.013123 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546bf80-4083-472a-872e-6b3da96419f6 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:10.013417 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546bf80-4083-472a-872e-6b3da96419f6 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:10.014920 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 52/103] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:10.025463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c08af8-abba-464e-8345-f5ea58fff858 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:10.025819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c08af8-abba-464e-8345-f5ea58fff858 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:10.026100 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c08af8-abba-464e-8345-f5ea58fff858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:10.053623 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-62c08af8-abba-464e-8345-f5ea58fff858 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:10.055114 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-62c08af8-abba-464e-8345-f5ea58fff858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:10.060769 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f2511-75b8-4258-88c3-69ed31ded48e None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:10.122494 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3995b-5f69-4c01-b085-05bec5e04b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:10.123317 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3995b-5f69-4c01-b085-05bec5e04b92 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:10.123561 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3995b-5f69-4c01-b085-05bec5e04b92 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:10.123843 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3995b-5f69-4c01-b085-05bec5e04b92 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:10.126164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3995b-5f69-4c01-b085-05bec5e04b92 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:10.127824 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3995b-5f69-4c01-b085-05bec5e04b92 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:10.129643 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 52/104] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:09 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:10.135551 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3995b-5f69-4c01-b085-05bec5e04b92 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:10.148521 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 53/105] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:10.194812 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c08af8-abba-464e-8345-f5ea58fff858 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:10.239008 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:10.372815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3995b-5f69-4c01-b085-05bec5e04b92 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:10.382698 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c08af8-abba-464e-8345-f5ea58fff858 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:10.388510 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:10.437915 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60c183-1870-4c18-a54c-a1b05d0115e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:10.443214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60c183-1870-4c18-a54c-a1b05d0115e7 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:10.443735 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60c183-1870-4c18-a54c-a1b05d0115e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:10.444221 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60c183-1870-4c18-a54c-a1b05d0115e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:10.479869 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60c183-1870-4c18-a54c-a1b05d0115e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-2c60c183-1870-4c18-a54c-a1b05d0115e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:10.485681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:10.486498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:10.487330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:10.487330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:10.487330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:10.487330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:10.487330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:10.487330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:10.487330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:10.487330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:10.487330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:10.487330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:10.487330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:10.487330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:10.489579 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 54/106] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:58:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:10.495467 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60c183-1870-4c18-a54c-a1b05d0115e7 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:10.503470 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f66b6a-6b3b-4b3f-883f-982c3e232d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:10.504183 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f66b6a-6b3b-4b3f-883f-982c3e232d96 None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:10.504473 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f66b6a-6b3b-4b3f-883f-982c3e232d96 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:10.504758 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f66b6a-6b3b-4b3f-883f-982c3e232d96 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d/users/daabac9b68d84dcdb04232880864f2ca/roles/5717836a50094587b879206794e7156a` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:10.511612 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f66b6a-6b3b-4b3f-883f-982c3e232d96 None admin] RBAC: Authorizing `identity:create_grant(project_id=c21bfcd3302f46909780c42e4b2d702d, user_id=daabac9b68d84dcdb04232880864f2ca, role_id=5717836a50094587b879206794e7156a)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:10.514008 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f66b6a-6b3b-4b3f-883f-982c3e232d96 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:10.535885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 53/107] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:58:10 2022] PUT /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d/users/daabac9b68d84dcdb04232880864f2ca/roles/5717836a50094587b879206794e7156a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:58:10.635764 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60c183-1870-4c18-a54c-a1b05d0115e7 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:10.690385 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c02a9-771e-441c-9372-deab3a93c9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:10.691431 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c02a9-771e-441c-9372-deab3a93c9dc None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:10.691908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c02a9-771e-441c-9372-deab3a93c9dc None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:10.692374 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c02a9-771e-441c-9372-deab3a93c9dc None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:10.693281 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c02a9-771e-441c-9372-deab3a93c9dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:10.693802 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c02a9-771e-441c-9372-deab3a93c9dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:10.695492 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c02a9-771e-441c-9372-deab3a93c9dc None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:10.707942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 55/108] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:10.713912 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f66b6a-6b3b-4b3f-883f-982c3e232d96 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:10.808145 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399e30a-6b05-4029-8ac9-02fff0da052f None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:10.808809 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399e30a-6b05-4029-8ac9-02fff0da052f None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:10.809435 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399e30a-6b05-4029-8ac9-02fff0da052f None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:10.811134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 56/109] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:10.829969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464cb71-cb7e-4f14-935f-f94740ffe034 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:10.831209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464cb71-cb7e-4f14-935f-f94740ffe034 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:10.831719 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464cb71-cb7e-4f14-935f-f94740ffe034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:10.871812 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-c464cb71-cb7e-4f14-935f-f94740ffe034 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:10.874511 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-c464cb71-cb7e-4f14-935f-f94740ffe034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:10.885919 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f66b6a-6b3b-4b3f-883f-982c3e232d96 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:10.899081 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:10.919079 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:10.961824 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608406e4-b55d-4e53-99ef-43c2ec34c17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:10.962519 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608406e4-b55d-4e53-99ef-43c2ec34c17e None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:10.962880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608406e4-b55d-4e53-99ef-43c2ec34c17e None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:10.963216 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608406e4-b55d-4e53-99ef-43c2ec34c17e None admin] PATH_INFO: `/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:10.965823 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608406e4-b55d-4e53-99ef-43c2ec34c17e None admin] RBAC: Authorizing `identity:get_user(user_id=4c1cfffdc2f44dac84acffeaa3f395e7)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:10.967266 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608406e4-b55d-4e53-99ef-43c2ec34c17e None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:10.969753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 54/110] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:10 2022] GET /identity/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:10.993351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608406e4-b55d-4e53-99ef-43c2ec34c17e None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:11.082914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 57/111] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:11.143052 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464cb71-cb7e-4f14-935f-f94740ffe034 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:11.150749 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608406e4-b55d-4e53-99ef-43c2ec34c17e None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:11.235346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0260b4-a97e-476b-aaf6-f47af4b7c7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:11.236309 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0260b4-a97e-476b-aaf6-f47af4b7c7c7 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:11.236750 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0260b4-a97e-476b-aaf6-f47af4b7c7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:11.237183 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0260b4-a97e-476b-aaf6-f47af4b7c7c7 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:11.239337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0260b4-a97e-476b-aaf6-f47af4b7c7c7 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:11.241215 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0260b4-a97e-476b-aaf6-f47af4b7c7c7 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:11.245849 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 55/112] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:10 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:11.252416 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0260b4-a97e-476b-aaf6-f47af4b7c7c7 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:11.343039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:11.377440 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464cb71-cb7e-4f14-935f-f94740ffe034 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:11.447091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b30e7-3034-42c6-b51c-aa0f5739613a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:11.447769 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b30e7-3034-42c6-b51c-aa0f5739613a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:11.448049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b30e7-3034-42c6-b51c-aa0f5739613a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:11.448320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b30e7-3034-42c6-b51c-aa0f5739613a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:11.454717 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b30e7-3034-42c6-b51c-aa0f5739613a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:11.456888 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b30e7-3034-42c6-b51c-aa0f5739613a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:11.462812 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 58/113] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:11.464285 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b30e7-3034-42c6-b51c-aa0f5739613a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:11.485188 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0260b4-a97e-476b-aaf6-f47af4b7c7c7 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:11.519252 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:11.539672 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb0596-25f5-4621-9570-88048ca1aef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:11.540670 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb0596-25f5-4621-9570-88048ca1aef8 None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:11.541229 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb0596-25f5-4621-9570-88048ca1aef8 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:11.541694 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb0596-25f5-4621-9570-88048ca1aef8 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d/users/4c1cfffdc2f44dac84acffeaa3f395e7/roles/5d947b934e0642c5a4ab00d547ec3fda` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:11.545042 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb0596-25f5-4621-9570-88048ca1aef8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c21bfcd3302f46909780c42e4b2d702d, user_id=4c1cfffdc2f44dac84acffeaa3f395e7, role_id=5d947b934e0642c5a4ab00d547ec3fda)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:11.547698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb0596-25f5-4621-9570-88048ca1aef8 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:11.578472 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 56/114] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:58:11 2022] PUT /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d/users/4c1cfffdc2f44dac84acffeaa3f395e7/roles/5d947b934e0642c5a4ab00d547ec3fda => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:58:11.668673 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b191ce4-5085-452c-b2f1-2aede5374809 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:11.668964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b191ce4-5085-452c-b2f1-2aede5374809 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:11.669168 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b191ce4-5085-452c-b2f1-2aede5374809 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:11.677036 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 57/115] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:11.682914 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b29701-3374-4a4d-9ff3-86c3439638da None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:11.683219 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b29701-3374-4a4d-9ff3-86c3439638da None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:11.683490 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b29701-3374-4a4d-9ff3-86c3439638da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:11.687827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b30e7-3034-42c6-b51c-aa0f5739613a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:11.724244 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-81b29701-3374-4a4d-9ff3-86c3439638da None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:11.725508 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-81b29701-3374-4a4d-9ff3-86c3439638da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:11.779294 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af7142-7e91-497a-984a-c941275197af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:11.780404 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7142-7e91-497a-984a-c941275197af None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:11.780943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7142-7e91-497a-984a-c941275197af None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:11.781501 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7142-7e91-497a-984a-c941275197af None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:11.782410 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af7142-7e91-497a-984a-c941275197af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:11.784118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af7142-7e91-497a-984a-c941275197af None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:11.809407 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 58/116] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:11.852979 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b29701-3374-4a4d-9ff3-86c3439638da None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:11.865702 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 59/117] 10.222.0.65 () {60 vars in 1141 bytes} [Mon Jul 25 23:58:11 2022] POST /identity/v3/projects => generated 302 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:58:11.911279 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c7d9b-bb8e-4755-ae4d-bcf76b287f4a None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:11.911910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c7d9b-bb8e-4755-ae4d-bcf76b287f4a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:11.912417 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c7d9b-bb8e-4755-ae4d-bcf76b287f4a None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:11.913048 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:11.914275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 60/118] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:11.923788 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed23737-684a-46b4-b318-a901e5763c53 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:11.924565 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed23737-684a-46b4-b318-a901e5763c53 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:11.925052 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed23737-684a-46b4-b318-a901e5763c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:11.950430 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-8ed23737-684a-46b4-b318-a901e5763c53 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:11.952145 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-8ed23737-684a-46b4-b318-a901e5763c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:12.020059 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b29701-3374-4a4d-9ff3-86c3439638da None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:12.062959 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 61/119] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:12.065369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52515b83-3e57-4b29-be44-ec1d880e5216 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:12.065777 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52515b83-3e57-4b29-be44-ec1d880e5216 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:12.066164 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52515b83-3e57-4b29-be44-ec1d880e5216 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:12.068553 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 62/120] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:12.074744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f87065-bb90-43c4-b0c5-5e1fb49792b8 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:12.074744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f87065-bb90-43c4-b0c5-5e1fb49792b8 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:12.074744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f87065-bb90-43c4-b0c5-5e1fb49792b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:12.081976 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591f18c-637e-4b2b-8c1e-23e20796e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:12.082516 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:12.082647 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591f18c-637e-4b2b-8c1e-23e20796e890 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:12.082975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591f18c-637e-4b2b-8c1e-23e20796e890 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:12.083554 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591f18c-637e-4b2b-8c1e-23e20796e890 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:12.100282 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-e9f87065-bb90-43c4-b0c5-5e1fb49792b8 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:12.102040 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-e9f87065-bb90-43c4-b0c5-5e1fb49792b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:12.111175 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591f18c-637e-4b2b-8c1e-23e20796e890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-8591f18c-637e-4b2b-8c1e-23e20796e890 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:12.116254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:12.117121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:12.117857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 59/121] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:12.118615 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591f18c-637e-4b2b-8c1e-23e20796e890 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:12.197713 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 63/122] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:12.198670 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f87065-bb90-43c4-b0c5-5e1fb49792b8 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:12.252238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:12.263854 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591f18c-637e-4b2b-8c1e-23e20796e890 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:12.304272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02fab8-826f-45ae-84a8-d0f89a65cc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:12.305183 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02fab8-826f-45ae-84a8-d0f89a65cc0e None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:12.305466 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02fab8-826f-45ae-84a8-d0f89a65cc0e None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:12.305738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02fab8-826f-45ae-84a8-d0f89a65cc0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:12.317564 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02fab8-826f-45ae-84a8-d0f89a65cc0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-7e02fab8-826f-45ae-84a8-d0f89a65cc0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:12.322496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:12.323350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:12.324170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 60/123] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:12.324787 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02fab8-826f-45ae-84a8-d0f89a65cc0e None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:12.330314 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f87065-bb90-43c4-b0c5-5e1fb49792b8 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:12.377130 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4054d4-8bf8-4e13-b3b8-60f2154dc9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:12.377770 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4054d4-8bf8-4e13-b3b8-60f2154dc9d7 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:12.378282 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4054d4-8bf8-4e13-b3b8-60f2154dc9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:12.378351 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4054d4-8bf8-4e13-b3b8-60f2154dc9d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:12.379070 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4054d4-8bf8-4e13-b3b8-60f2154dc9d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:12.379960 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4054d4-8bf8-4e13-b3b8-60f2154dc9d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:12.381815 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4054d4-8bf8-4e13-b3b8-60f2154dc9d7 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:12.383828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:12.393092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 64/124] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:12.393937 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4054d4-8bf8-4e13-b3b8-60f2154dc9d7 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:12.493635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02fab8-826f-45ae-84a8-d0f89a65cc0e None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:12.550380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c574a7-6e35-4945-a520-3c6741f202e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:12.551159 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c574a7-6e35-4945-a520-3c6741f202e6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:12.551443 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c574a7-6e35-4945-a520-3c6741f202e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:12.552001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c574a7-6e35-4945-a520-3c6741f202e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:12.564487 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c574a7-6e35-4945-a520-3c6741f202e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-42c574a7-6e35-4945-a520-3c6741f202e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:12.570315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:12.571194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:12.571955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:12.571955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:12.571955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:12.571955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:12.571955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:12.571955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:12.571955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:12.571955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:12.571955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:12.571955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:12.571955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:12.571955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:12.572528 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 61/125] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:58:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:12.574790 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c574a7-6e35-4945-a520-3c6741f202e6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:12.594002 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4054d4-8bf8-4e13-b3b8-60f2154dc9d7 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:12.595518 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:12.675445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b574a-de4e-47aa-939d-e26e593deb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:12.676076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b574a-de4e-47aa-939d-e26e593deb46 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:12.676361 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b574a-de4e-47aa-939d-e26e593deb46 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:12.676638 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b574a-de4e-47aa-939d-e26e593deb46 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:12.677359 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b574a-de4e-47aa-939d-e26e593deb46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:12.677665 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b574a-de4e-47aa-939d-e26e593deb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:12.679095 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b574a-de4e-47aa-939d-e26e593deb46 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:12.689336 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 65/126] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:12.689994 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b574a-de4e-47aa-939d-e26e593deb46 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:12.733519 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c574a7-6e35-4945-a520-3c6741f202e6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:12.756481 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:12.807451 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b574a-de4e-47aa-939d-e26e593deb46 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:12.825007 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49452a-af1b-4c9c-8a8a-b056d10002cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:12.825673 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49452a-af1b-4c9c-8a8a-b056d10002cb None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:12.825964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49452a-af1b-4c9c-8a8a-b056d10002cb None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:12.826247 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49452a-af1b-4c9c-8a8a-b056d10002cb None admin] PATH_INFO: `/v3/users/daabac9b68d84dcdb04232880864f2ca` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:12.829072 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49452a-af1b-4c9c-8a8a-b056d10002cb None admin] RBAC: Authorizing `identity:get_user(user_id=daabac9b68d84dcdb04232880864f2ca)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:12.830639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49452a-af1b-4c9c-8a8a-b056d10002cb None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:12.832497 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 62/127] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:12 2022] GET /identity/v3/users/daabac9b68d84dcdb04232880864f2ca => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:12.833108 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49452a-af1b-4c9c-8a8a-b056d10002cb None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:12.846570 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fe999-54aa-4e06-ae93-c61f101af7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:12.847246 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fe999-54aa-4e06-ae93-c61f101af7d9 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:12.847527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fe999-54aa-4e06-ae93-c61f101af7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:12.850747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fe999-54aa-4e06-ae93-c61f101af7d9 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:12.850747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fe999-54aa-4e06-ae93-c61f101af7d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:12.850747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fe999-54aa-4e06-ae93-c61f101af7d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:12.850747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fe999-54aa-4e06-ae93-c61f101af7d9 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:12.858923 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 66/128] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:58:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:12.860505 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fe999-54aa-4e06-ae93-c61f101af7d9 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:12.979718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fe999-54aa-4e06-ae93-c61f101af7d9 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:13.007032 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:13.013346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:13.025393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94708da-3a9d-4ed0-bb5b-13169c9654bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:13.026145 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94708da-3a9d-4ed0-bb5b-13169c9654bb None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:13.026437 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94708da-3a9d-4ed0-bb5b-13169c9654bb None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:13.026735 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94708da-3a9d-4ed0-bb5b-13169c9654bb None admin] PATH_INFO: `/v3/projects/7b99b0c6154d4d97952c718a174ed6d1` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:13.027892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94708da-3a9d-4ed0-bb5b-13169c9654bb None admin] RBAC: Authorizing `identity:get_project(project_id=7b99b0c6154d4d97952c718a174ed6d1)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:13.029345 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94708da-3a9d-4ed0-bb5b-13169c9654bb None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:13.031812 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 67/129] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:12 2022] GET /identity/v3/projects/7b99b0c6154d4d97952c718a174ed6d1 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:13.032410 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94708da-3a9d-4ed0-bb5b-13169c9654bb None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:13.070045 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49452a-af1b-4c9c-8a8a-b056d10002cb None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:13.139079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fc647-8a8f-4f49-90c4-934f98ef372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:13.139735 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fc647-8a8f-4f49-90c4-934f98ef372f None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:13.140018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fc647-8a8f-4f49-90c4-934f98ef372f None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:13.140882 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fc647-8a8f-4f49-90c4-934f98ef372f None admin] PATH_INFO: `/v3/users/fc39e66b7e194e958d72d1dd99cb493e` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:13.172057 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fc647-8a8f-4f49-90c4-934f98ef372f None admin] RBAC: Authorizing `identity:get_user(user_id=fc39e66b7e194e958d72d1dd99cb493e)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:13.173693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fc647-8a8f-4f49-90c4-934f98ef372f None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:13.175427 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 63/130] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:12 2022] GET /identity/v3/users/fc39e66b7e194e958d72d1dd99cb493e => generated 289 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:13.176171 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fc647-8a8f-4f49-90c4-934f98ef372f None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:13.199192 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94708da-3a9d-4ed0-bb5b-13169c9654bb None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:13.236767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98ca1a-722d-44b5-9b34-9f269c957a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:13.237522 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98ca1a-722d-44b5-9b34-9f269c957a56 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:13.237810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98ca1a-722d-44b5-9b34-9f269c957a56 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:13.238088 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98ca1a-722d-44b5-9b34-9f269c957a56 None admin] PATH_INFO: `/v3/users/daabac9b68d84dcdb04232880864f2ca` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:13.239383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98ca1a-722d-44b5-9b34-9f269c957a56 None admin] RBAC: Authorizing `identity:get_user(user_id=daabac9b68d84dcdb04232880864f2ca)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:13.240831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98ca1a-722d-44b5-9b34-9f269c957a56 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:13.242591 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 68/131] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:13 2022] GET /identity/v3/users/daabac9b68d84dcdb04232880864f2ca => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:13.247450 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98ca1a-722d-44b5-9b34-9f269c957a56 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:13.308620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:13.338744 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fc647-8a8f-4f49-90c4-934f98ef372f None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:13.397902 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98ca1a-722d-44b5-9b34-9f269c957a56 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:13.403464 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e9def-0c29-49a0-a3a2-6a0d14416fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:13.404171 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e9def-0c29-49a0-a3a2-6a0d14416fe6 None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:13.404460 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e9def-0c29-49a0-a3a2-6a0d14416fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:13.404747 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e9def-0c29-49a0-a3a2-6a0d14416fe6 None admin] PATH_INFO: `/v3/projects/7b99b0c6154d4d97952c718a174ed6d1/users/daabac9b68d84dcdb04232880864f2ca/roles/5717836a50094587b879206794e7156a` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:13.412194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e9def-0c29-49a0-a3a2-6a0d14416fe6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b99b0c6154d4d97952c718a174ed6d1, user_id=daabac9b68d84dcdb04232880864f2ca, role_id=5717836a50094587b879206794e7156a)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:13.413723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e9def-0c29-49a0-a3a2-6a0d14416fe6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:13.431692 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:13.438209 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 64/132] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:58:13 2022] PUT /identity/v3/projects/7b99b0c6154d4d97952c718a174ed6d1/users/daabac9b68d84dcdb04232880864f2ca/roles/5717836a50094587b879206794e7156a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:58:13.438953 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e9def-0c29-49a0-a3a2-6a0d14416fe6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:13.472576 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15def1fb-20ea-47f9-b692-407bf63a6fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:13.473214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15def1fb-20ea-47f9-b692-407bf63a6fbf None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:13.473502 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15def1fb-20ea-47f9-b692-407bf63a6fbf None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:13.473785 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15def1fb-20ea-47f9-b692-407bf63a6fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:13.622837 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15def1fb-20ea-47f9-b692-407bf63a6fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:13.622837 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15def1fb-20ea-47f9-b692-407bf63a6fbf None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:13.646358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e9def-0c29-49a0-a3a2-6a0d14416fe6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:13.713137 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368b39f-90eb-44fa-a8c9-5d646653aa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:13.714172 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368b39f-90eb-44fa-a8c9-5d646653aa2c None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:13.714674 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368b39f-90eb-44fa-a8c9-5d646653aa2c None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:13.715181 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368b39f-90eb-44fa-a8c9-5d646653aa2c None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:13.716670 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368b39f-90eb-44fa-a8c9-5d646653aa2c None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:13.718945 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368b39f-90eb-44fa-a8c9-5d646653aa2c None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:13.725044 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 65/133] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:13 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:13.727290 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368b39f-90eb-44fa-a8c9-5d646653aa2c None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:13.733766 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:13.817485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 69/134] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:13.818568 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bde29-00ba-488d-a990-aae5d3ef0260 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:13.819300 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bde29-00ba-488d-a990-aae5d3ef0260 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:13.819476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bde29-00ba-488d-a990-aae5d3ef0260 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:13.820921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 70/135] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:13.825389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bde29-00ba-488d-a990-aae5d3ef0260 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:13.832655 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:13.871108 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368b39f-90eb-44fa-a8c9-5d646653aa2c None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:13.930321 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bde29-00ba-488d-a990-aae5d3ef0260 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:13.932292 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5b6e6-6bb3-4f44-823f-bfc92b2ebfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:13.933357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5b6e6-6bb3-4f44-823f-bfc92b2ebfbc None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:13.933841 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5b6e6-6bb3-4f44-823f-bfc92b2ebfbc None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:13.934326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5b6e6-6bb3-4f44-823f-bfc92b2ebfbc None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d/users/daabac9b68d84dcdb04232880864f2ca/roles/c88cff91a5454c9ea5c03c9eb0a7a2aa` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:13.945502 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5b6e6-6bb3-4f44-823f-bfc92b2ebfbc None admin] RBAC: Authorizing `identity:create_grant(project_id=c21bfcd3302f46909780c42e4b2d702d, user_id=daabac9b68d84dcdb04232880864f2ca, role_id=c88cff91a5454c9ea5c03c9eb0a7a2aa)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:13.947275 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5b6e6-6bb3-4f44-823f-bfc92b2ebfbc None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:13.976771 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 66/136] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:58:13 2022] PUT /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d/users/daabac9b68d84dcdb04232880864f2ca/roles/c88cff91a5454c9ea5c03c9eb0a7a2aa => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:58:13.978454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc3c9d-d2d5-4b4a-9b01-e9bb6da12283 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:13.978964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc3c9d-d2d5-4b4a-9b01-e9bb6da12283 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:13.979453 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc3c9d-d2d5-4b4a-9b01-e9bb6da12283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:14.014226 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70590b-a722-4372-9798-9d1da8cae107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:14.014991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70590b-a722-4372-9798-9d1da8cae107 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:14.017611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70590b-a722-4372-9798-9d1da8cae107 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:14.017935 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70590b-a722-4372-9798-9d1da8cae107 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:14.023695 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70590b-a722-4372-9798-9d1da8cae107 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:14.026252 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70590b-a722-4372-9798-9d1da8cae107 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:14.032772 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-17bc3c9d-d2d5-4b4a-9b01-e9bb6da12283 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:14.033470 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 71/137] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:13 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:14.034356 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-17bc3c9d-d2d5-4b4a-9b01-e9bb6da12283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:14.043967 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70590b-a722-4372-9798-9d1da8cae107 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:14.114343 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:14.194670 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 67/138] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:14.242132 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc3c9d-d2d5-4b4a-9b01-e9bb6da12283 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:14.302782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70590b-a722-4372-9798-9d1da8cae107 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:14.339717 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:14.362601 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6fe7f-e34f-47ce-b11f-86915da78b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:14.363665 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6fe7f-e34f-47ce-b11f-86915da78b7f None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:14.364160 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6fe7f-e34f-47ce-b11f-86915da78b7f None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:14.364651 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6fe7f-e34f-47ce-b11f-86915da78b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:14.365796 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6fe7f-e34f-47ce-b11f-86915da78b7f None admin] RBAC: Adding query filter params (role.id=d468e85ca7384bef9a2e312a37b543fa, scope.project.id=c21bfcd3302f46909780c42e4b2d702d, user.id=fc39e66b7e194e958d72d1dd99cb493e) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:14.366329 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6fe7f-e34f-47ce-b11f-86915da78b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:14.368140 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6fe7f-e34f-47ce-b11f-86915da78b7f None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:14.382877 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 72/139] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:14 2022] GET /identity/v3/role_assignments?user.id=fc39e66b7e194e958d72d1dd99cb493e&scope.project.id=c21bfcd3302f46909780c42e4b2d702d&role.id=d468e85ca7384bef9a2e312a37b543fa => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:14.395212 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc3c9d-d2d5-4b4a-9b01-e9bb6da12283 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:14.440171 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fc8ee-adfd-47fa-8d00-24dc7a27c566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:14.440833 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fc8ee-adfd-47fa-8d00-24dc7a27c566 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:14.441116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fc8ee-adfd-47fa-8d00-24dc7a27c566 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:14.441394 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fc8ee-adfd-47fa-8d00-24dc7a27c566 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:14.458726 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fc8ee-adfd-47fa-8d00-24dc7a27c566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-407fc8ee-adfd-47fa-8d00-24dc7a27c566 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:14.463534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:14.464450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:14.465698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 68/140] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:14.470869 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6fe7f-e34f-47ce-b11f-86915da78b7f None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:14.599104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:14.607035 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6fe7f-e34f-47ce-b11f-86915da78b7f None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:14.666316 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeda791-420e-4665-80dd-0a5fdc5423ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:14.666980 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeda791-420e-4665-80dd-0a5fdc5423ce None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:14.667267 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeda791-420e-4665-80dd-0a5fdc5423ce None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:14.667546 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeda791-420e-4665-80dd-0a5fdc5423ce None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:14.668273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeda791-420e-4665-80dd-0a5fdc5423ce None admin] RBAC: Adding query filter params (name=member) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:14.668583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeda791-420e-4665-80dd-0a5fdc5423ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:14.669986 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeda791-420e-4665-80dd-0a5fdc5423ce None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:14.680494 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 73/141] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:14.686330 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fc8ee-adfd-47fa-8d00-24dc7a27c566 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:14.808540 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fc8ee-adfd-47fa-8d00-24dc7a27c566 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:14.826766 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:14.846483 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd62635-ad9a-4740-939d-ef36eb398771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:14.847176 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd62635-ad9a-4740-939d-ef36eb398771 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:14.847514 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd62635-ad9a-4740-939d-ef36eb398771 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:14.847803 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd62635-ad9a-4740-939d-ef36eb398771 None admin] PATH_INFO: `/v3/users/daabac9b68d84dcdb04232880864f2ca` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:14.849010 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd62635-ad9a-4740-939d-ef36eb398771 None admin] RBAC: Authorizing `identity:get_user(user_id=daabac9b68d84dcdb04232880864f2ca)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:14.850479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd62635-ad9a-4740-939d-ef36eb398771 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:14.852124 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 69/142] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:14 2022] GET /identity/v3/users/daabac9b68d84dcdb04232880864f2ca => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:14.857828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeda791-420e-4665-80dd-0a5fdc5423ce None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:14.971563 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeda791-420e-4665-80dd-0a5fdc5423ce None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:15.001770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f739956-839a-4cdd-932e-d66950ad488b None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:15.002059 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f739956-839a-4cdd-932e-d66950ad488b None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:15.002328 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f739956-839a-4cdd-932e-d66950ad488b None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:15.003715 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 70/143] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:15.009002 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185671d5-b815-4451-ac61-f41cf3dd5e22 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:15.009286 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185671d5-b815-4451-ac61-f41cf3dd5e22 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:15.009567 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185671d5-b815-4451-ac61-f41cf3dd5e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:15.026569 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2cd4c-3265-4929-a450-1d3a855db635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:15.027238 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2cd4c-3265-4929-a450-1d3a855db635 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:15.027523 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2cd4c-3265-4929-a450-1d3a855db635 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:15.027797 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2cd4c-3265-4929-a450-1d3a855db635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:15.038440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-185671d5-b815-4451-ac61-f41cf3dd5e22 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:15.040527 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-185671d5-b815-4451-ac61-f41cf3dd5e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:15.053475 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:15.108543 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2cd4c-3265-4929-a450-1d3a855db635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:15.110353 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2cd4c-3265-4929-a450-1d3a855db635 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:15.227131 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 74/144] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:15.228821 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620bfd-b848-42fe-bfe9-8e72a9d6c185 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:15.229112 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620bfd-b848-42fe-bfe9-8e72a9d6c185 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:15.229395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620bfd-b848-42fe-bfe9-8e72a9d6c185 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:15.231123 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 75/145] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:15.233497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d620bfd-b848-42fe-bfe9-8e72a9d6c185 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:15.246349 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 71/146] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:15.248075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d91e-6287-4934-93c0-cd102ee59b31 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:15.248555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d91e-6287-4934-93c0-cd102ee59b31 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:15.249040 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d91e-6287-4934-93c0-cd102ee59b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:15.285004 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-2118d91e-6287-4934-93c0-cd102ee59b31 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:15.286584 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-2118d91e-6287-4934-93c0-cd102ee59b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:15.301331 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:15.368050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 72/147] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:15.369690 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d91e-6287-4934-93c0-cd102ee59b31 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:15.431140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:15.467810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d620bfd-b848-42fe-bfe9-8e72a9d6c185 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:15.513488 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d91e-6287-4934-93c0-cd102ee59b31 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:15.537374 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857d921-b2dd-4776-9b51-dd1601a153a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:15.538021 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857d921-b2dd-4776-9b51-dd1601a153a4 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:15.538302 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857d921-b2dd-4776-9b51-dd1601a153a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:15.538579 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857d921-b2dd-4776-9b51-dd1601a153a4 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:15.540530 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857d921-b2dd-4776-9b51-dd1601a153a4 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:15.541976 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857d921-b2dd-4776-9b51-dd1601a153a4 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:15.543662 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 76/148] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:15 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:15.544424 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857d921-b2dd-4776-9b51-dd1601a153a4 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:15.581538 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50532405-146d-48a3-8126-7a6614afbfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:15.582196 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50532405-146d-48a3-8126-7a6614afbfe2 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:15.582476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50532405-146d-48a3-8126-7a6614afbfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:15.582775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50532405-146d-48a3-8126-7a6614afbfe2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:15.587816 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50532405-146d-48a3-8126-7a6614afbfe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:15.589270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50532405-146d-48a3-8126-7a6614afbfe2 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:15.594391 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 73/149] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:15.595516 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50532405-146d-48a3-8126-7a6614afbfe2 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:15.723564 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857d921-b2dd-4776-9b51-dd1601a153a4 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:15.744592 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:15.773093 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb70c-da53-4d3a-826b-500263a396fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:15.773759 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb70c-da53-4d3a-826b-500263a396fd None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:15.774041 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb70c-da53-4d3a-826b-500263a396fd None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:15.774319 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feb70c-da53-4d3a-826b-500263a396fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:15.787646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7feb70c-da53-4d3a-826b-500263a396fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-a7feb70c-da53-4d3a-826b-500263a396fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:15.793146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:15.794008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:15.795213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:15.795213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:15.795213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:15.795213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:15.795213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:15.795213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:15.795213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:15.795213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:15.795213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:15.795213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:15.795213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:15.795213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:15.799383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 77/150] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:58:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:15.800401 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb70c-da53-4d3a-826b-500263a396fd None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:15.824816 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50532405-146d-48a3-8126-7a6614afbfe2 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:15.855048 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:15.894857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e3a63-30c2-421e-ac37-b18e310cb2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:15.895532 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e3a63-30c2-421e-ac37-b18e310cb2b6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:15.895822 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e3a63-30c2-421e-ac37-b18e310cb2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:15.896101 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e3a63-30c2-421e-ac37-b18e310cb2b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:15.896890 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e3a63-30c2-421e-ac37-b18e310cb2b6 None admin] RBAC: Adding query filter params (role.id=5717836a50094587b879206794e7156a, scope.project.id=c21bfcd3302f46909780c42e4b2d702d, user.id=daabac9b68d84dcdb04232880864f2ca) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:15.897198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e3a63-30c2-421e-ac37-b18e310cb2b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:15.898649 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e3a63-30c2-421e-ac37-b18e310cb2b6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:15.920091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feb70c-da53-4d3a-826b-500263a396fd None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:15.921018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 74/151] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:15 2022] GET /identity/v3/role_assignments?user.id=daabac9b68d84dcdb04232880864f2ca&scope.project.id=c21bfcd3302f46909780c42e4b2d702d&role.id=5717836a50094587b879206794e7156a => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:15.922102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e3a63-30c2-421e-ac37-b18e310cb2b6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:16.016170 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64270fc8-19f8-4309-bc66-cf6466c2af20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:16.016826 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270fc8-19f8-4309-bc66-cf6466c2af20 None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:16.017118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270fc8-19f8-4309-bc66-cf6466c2af20 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:16.017400 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270fc8-19f8-4309-bc66-cf6466c2af20 None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:16.018101 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64270fc8-19f8-4309-bc66-cf6466c2af20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:16.019669 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64270fc8-19f8-4309-bc66-cf6466c2af20 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:16.073385 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 78/152] 10.222.0.65 () {60 vars in 1132 bytes} [Mon Jul 25 23:58:15 2022] POST /identity/v3/users => generated 283 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:58:16.139524 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e3a63-30c2-421e-ac37-b18e310cb2b6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:16.203204 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218bfc2-18a3-4b51-a635-8eda7ddf2dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:16.203879 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218bfc2-18a3-4b51-a635-8eda7ddf2dc1 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:16.204157 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218bfc2-18a3-4b51-a635-8eda7ddf2dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:16.204432 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218bfc2-18a3-4b51-a635-8eda7ddf2dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:16.205166 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218bfc2-18a3-4b51-a635-8eda7ddf2dc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:16.205475 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218bfc2-18a3-4b51-a635-8eda7ddf2dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:16.206916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218bfc2-18a3-4b51-a635-8eda7ddf2dc1 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:16.226028 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 75/153] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:16.232599 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64270fc8-19f8-4309-bc66-cf6466c2af20 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:16.278637 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:16.356611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64270fc8-19f8-4309-bc66-cf6466c2af20 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:16.403141 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3071e-ad5b-4e8c-b9bb-41680fedf142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:16.403812 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3071e-ad5b-4e8c-b9bb-41680fedf142 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:16.404729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3071e-ad5b-4e8c-b9bb-41680fedf142 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:16.405032 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3071e-ad5b-4e8c-b9bb-41680fedf142 None admin] PATH_INFO: `/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:16.406848 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3071e-ad5b-4e8c-b9bb-41680fedf142 None admin] RBAC: Authorizing `identity:get_user(user_id=4c1cfffdc2f44dac84acffeaa3f395e7)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:16.408477 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3071e-ad5b-4e8c-b9bb-41680fedf142 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:16.410885 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 79/154] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:16 2022] GET /identity/v3/users/4c1cfffdc2f44dac84acffeaa3f395e7 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:16.416331 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218bfc2-18a3-4b51-a635-8eda7ddf2dc1 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:16.510527 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:16.578944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f580e3-dbee-4edb-af14-27d936be3f1c None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:16.579901 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f580e3-dbee-4edb-af14-27d936be3f1c None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:16.580408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f580e3-dbee-4edb-af14-27d936be3f1c None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:16.582102 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 80/155] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:16.585274 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218bfc2-18a3-4b51-a635-8eda7ddf2dc1 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:16.587698 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fee0d-7cbd-4197-a46f-9762a5b85c79 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:16.588323 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fee0d-7cbd-4197-a46f-9762a5b85c79 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:16.588673 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fee0d-7cbd-4197-a46f-9762a5b85c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:16.613242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-bf2fee0d-7cbd-4197-a46f-9762a5b85c79 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:16.613415 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-bf2fee0d-7cbd-4197-a46f-9762a5b85c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:16.632826 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f455b-8d89-47e4-b686-279c1587ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:16.633875 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f455b-8d89-47e4-b686-279c1587ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:16.634346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f455b-8d89-47e4-b686-279c1587ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:16.634862 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f455b-8d89-47e4-b686-279c1587ecc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:16.715616 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 81/156] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:16.722673 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f455b-8d89-47e4-b686-279c1587ecc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:16.724507 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f455b-8d89-47e4-b686-279c1587ecc8 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:16.741952 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fee0d-7cbd-4197-a46f-9762a5b85c79 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:16.767716 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:16.785691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:16.834647 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 76/157] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:16.841677 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f455b-8d89-47e4-b686-279c1587ecc8 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:16.882646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fee0d-7cbd-4197-a46f-9762a5b85c79 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:16.930823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396432-0c2c-48b0-8f98-3cae4d30ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:16.931481 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396432-0c2c-48b0-8f98-3cae4d30ef6c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:16.931763 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396432-0c2c-48b0-8f98-3cae4d30ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:16.932057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396432-0c2c-48b0-8f98-3cae4d30ef6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:16.943829 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396432-0c2c-48b0-8f98-3cae4d30ef6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-cb396432-0c2c-48b0-8f98-3cae4d30ef6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:16.949406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:16.950369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:16.951512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 82/158] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:16.957076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396432-0c2c-48b0-8f98-3cae4d30ef6c None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:16.959256 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f455b-8d89-47e4-b686-279c1587ecc8 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:17.009241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a325f-04c0-4ef8-98cc-d38182181cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:17.010252 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a325f-04c0-4ef8-98cc-d38182181cce None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:17.010839 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a325f-04c0-4ef8-98cc-d38182181cce None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:17.011305 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a325f-04c0-4ef8-98cc-d38182181cce None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:17.012795 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a325f-04c0-4ef8-98cc-d38182181cce None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:17.014579 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a325f-04c0-4ef8-98cc-d38182181cce None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:17.017496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 77/159] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:16 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:17.026876 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a325f-04c0-4ef8-98cc-d38182181cce None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:17.039185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:17.091889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:17.104653 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396432-0c2c-48b0-8f98-3cae4d30ef6c None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:17.144653 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc049b27-56f7-4c98-bb07-f17ad8249ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:17.145308 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc049b27-56f7-4c98-bb07-f17ad8249ed4 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:17.145609 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc049b27-56f7-4c98-bb07-f17ad8249ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:17.145869 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc049b27-56f7-4c98-bb07-f17ad8249ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:17.146785 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc049b27-56f7-4c98-bb07-f17ad8249ed4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:17.147031 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc049b27-56f7-4c98-bb07-f17ad8249ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:17.148498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc049b27-56f7-4c98-bb07-f17ad8249ed4 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:17.158360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 83/160] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:17.164074 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc049b27-56f7-4c98-bb07-f17ad8249ed4 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:17.179420 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a325f-04c0-4ef8-98cc-d38182181cce None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:17.225412 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc323b-7894-41ba-9165-9ffdbc7b24af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:17.226830 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc323b-7894-41ba-9165-9ffdbc7b24af None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:17.227580 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc323b-7894-41ba-9165-9ffdbc7b24af None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:17.228041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc323b-7894-41ba-9165-9ffdbc7b24af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:17.228984 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc323b-7894-41ba-9165-9ffdbc7b24af None admin] RBAC: Adding query filter params (role.id=5d947b934e0642c5a4ab00d547ec3fda, scope.project.id=c21bfcd3302f46909780c42e4b2d702d, user.id=4c1cfffdc2f44dac84acffeaa3f395e7) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:17.229465 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc323b-7894-41ba-9165-9ffdbc7b24af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:17.231403 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc323b-7894-41ba-9165-9ffdbc7b24af None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:17.240193 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 78/161] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:17 2022] GET /identity/v3/role_assignments?user.id=4c1cfffdc2f44dac84acffeaa3f395e7&scope.project.id=c21bfcd3302f46909780c42e4b2d702d&role.id=5d947b934e0642c5a4ab00d547ec3fda => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:17.316713 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc049b27-56f7-4c98-bb07-f17ad8249ed4 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:17.363122 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24040fb0-48ad-4078-b915-4fdf33140c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:17.363716 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24040fb0-48ad-4078-b915-4fdf33140c79 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:17.364002 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24040fb0-48ad-4078-b915-4fdf33140c79 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:17.364283 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24040fb0-48ad-4078-b915-4fdf33140c79 None admin] PATH_INFO: `/v3/users/daabac9b68d84dcdb04232880864f2ca` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:17.365532 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24040fb0-48ad-4078-b915-4fdf33140c79 None admin] RBAC: Authorizing `identity:get_user(user_id=daabac9b68d84dcdb04232880864f2ca)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:17.367037 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24040fb0-48ad-4078-b915-4fdf33140c79 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:17.368707 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 84/162] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:17 2022] GET /identity/v3/users/daabac9b68d84dcdb04232880864f2ca => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:17.374752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc323b-7894-41ba-9165-9ffdbc7b24af None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:17.481513 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:17.511209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b83ad-e3fd-4c67-a5aa-0ae3c4cc925e None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:17.511662 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b83ad-e3fd-4c67-a5aa-0ae3c4cc925e None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:17.511975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b83ad-e3fd-4c67-a5aa-0ae3c4cc925e None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:17.513417 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 85/163] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:17.518989 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05075a-54f0-4b0a-ae33-3ec314988f0a None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:17.519323 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05075a-54f0-4b0a-ae33-3ec314988f0a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:17.519595 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05075a-54f0-4b0a-ae33-3ec314988f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:17.521549 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc323b-7894-41ba-9165-9ffdbc7b24af None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:17.549681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-3a05075a-54f0-4b0a-ae33-3ec314988f0a None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:17.551561 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-3a05075a-54f0-4b0a-ae33-3ec314988f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:17.561116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f37baa-138c-4a41-b6c5-da0739e4439d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:17.562680 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37baa-138c-4a41-b6c5-da0739e4439d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:17.563349 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37baa-138c-4a41-b6c5-da0739e4439d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:17.563828 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37baa-138c-4a41-b6c5-da0739e4439d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:17.576474 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:17.637378 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 86/164] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:17.639286 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c246-afed-4870-b955-5a3740ecf1f8 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:17.639872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c246-afed-4870-b955-5a3740ecf1f8 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:17.640909 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c246-afed-4870-b955-5a3740ecf1f8 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:17.643057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 87/165] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:17.644901 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f37baa-138c-4a41-b6c5-da0739e4439d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:17.646663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f37baa-138c-4a41-b6c5-da0739e4439d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:17.648773 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b585b-ecae-44ec-a4f3-d817397efc2b None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:17.649232 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b585b-ecae-44ec-a4f3-d817397efc2b None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:17.649520 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b585b-ecae-44ec-a4f3-d817397efc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:17.669715 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-c39b585b-ecae-44ec-a4f3-d817397efc2b None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:17.671912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-c39b585b-ecae-44ec-a4f3-d817397efc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:17.731290 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:17.759434 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 88/166] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:17.760782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b585b-ecae-44ec-a4f3-d817397efc2b None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:17.775383 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 79/167] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:17.781734 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f37baa-138c-4a41-b6c5-da0739e4439d None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:17.865786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:17.894850 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b585b-ecae-44ec-a4f3-d817397efc2b None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:17.932824 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f37baa-138c-4a41-b6c5-da0739e4439d None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:17.972913 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6bbe4-0dbc-4ee7-bcb6-82aa51f31359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:17.973584 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6bbe4-0dbc-4ee7-bcb6-82aa51f31359 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:17.973866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6bbe4-0dbc-4ee7-bcb6-82aa51f31359 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:17.976780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6bbe4-0dbc-4ee7-bcb6-82aa51f31359 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:17.982472 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978224f-6bd4-485d-841e-45c6fb6e5c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:17.987198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978224f-6bd4-485d-841e-45c6fb6e5c76 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:17.987198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978224f-6bd4-485d-841e-45c6fb6e5c76 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:17.987198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978224f-6bd4-485d-841e-45c6fb6e5c76 None admin] PATH_INFO: `/v3/projects/7b99b0c6154d4d97952c718a174ed6d1` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:17.991309 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978224f-6bd4-485d-841e-45c6fb6e5c76 None admin] RBAC: Authorizing `identity:get_project(project_id=7b99b0c6154d4d97952c718a174ed6d1)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:17.998728 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978224f-6bd4-485d-841e-45c6fb6e5c76 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:17.998728 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 80/168] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:17 2022] GET /identity/v3/projects/7b99b0c6154d4d97952c718a174ed6d1 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:18.006855 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978224f-6bd4-485d-841e-45c6fb6e5c76 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:18.008206 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6bbe4-0dbc-4ee7-bcb6-82aa51f31359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-14a6bbe4-0dbc-4ee7-bcb6-82aa51f31359 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:18.013271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:18.014289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:18.015207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 89/169] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:18.023608 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6bbe4-0dbc-4ee7-bcb6-82aa51f31359 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:18.052558 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:18.142497 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978224f-6bd4-485d-841e-45c6fb6e5c76 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:18.198661 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0106683-3557-4f8f-9736-a03b22d276c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:18.198661 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106683-3557-4f8f-9736-a03b22d276c6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:18.198956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106683-3557-4f8f-9736-a03b22d276c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:18.199530 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106683-3557-4f8f-9736-a03b22d276c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:18.221778 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0106683-3557-4f8f-9736-a03b22d276c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-a0106683-3557-4f8f-9736-a03b22d276c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:18.227457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:18.228307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:18.229150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 81/170] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:58:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:18.229777 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0106683-3557-4f8f-9736-a03b22d276c6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:18.271047 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6bbe4-0dbc-4ee7-bcb6-82aa51f31359 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:18.310582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50221da7-86f2-43ff-a3e4-c97059fa65c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:18.311242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50221da7-86f2-43ff-a3e4-c97059fa65c1 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:18.311535 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50221da7-86f2-43ff-a3e4-c97059fa65c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:18.312364 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50221da7-86f2-43ff-a3e4-c97059fa65c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:18.313150 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50221da7-86f2-43ff-a3e4-c97059fa65c1 None admin] RBAC: Adding query filter params (role.id=5717836a50094587b879206794e7156a, scope.project.id=7b99b0c6154d4d97952c718a174ed6d1, user.id=daabac9b68d84dcdb04232880864f2ca) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:18.313462 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50221da7-86f2-43ff-a3e4-c97059fa65c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:18.315085 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50221da7-86f2-43ff-a3e4-c97059fa65c1 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:18.321855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 90/171] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:18 2022] GET /identity/v3/role_assignments?user.id=daabac9b68d84dcdb04232880864f2ca&scope.project.id=7b99b0c6154d4d97952c718a174ed6d1&role.id=5717836a50094587b879206794e7156a => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:18.328287 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50221da7-86f2-43ff-a3e4-c97059fa65c1 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:18.344271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:18.474372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:18.488755 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0106683-3557-4f8f-9736-a03b22d276c6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:18.522284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50221da7-86f2-43ff-a3e4-c97059fa65c1 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:18.564603 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f08d5-95c7-45c7-aa59-489013ab59fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:18.565612 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f08d5-95c7-45c7-aa59-489013ab59fa None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:18.566089 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f08d5-95c7-45c7-aa59-489013ab59fa None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:18.566582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f08d5-95c7-45c7-aa59-489013ab59fa None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:18.567730 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f08d5-95c7-45c7-aa59-489013ab59fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:18.568237 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f08d5-95c7-45c7-aa59-489013ab59fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:18.570119 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f08d5-95c7-45c7-aa59-489013ab59fa None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:18.580908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 91/172] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:58:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:18.587329 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f08d5-95c7-45c7-aa59-489013ab59fa None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:18.587740 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9990538-6801-4b28-8812-434b12e23f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:18.590416 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9990538-6801-4b28-8812-434b12e23f1b None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:18.590416 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9990538-6801-4b28-8812-434b12e23f1b None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:18.590416 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9990538-6801-4b28-8812-434b12e23f1b None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:18.590416 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9990538-6801-4b28-8812-434b12e23f1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:18.590416 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9990538-6801-4b28-8812-434b12e23f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:18.591414 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9990538-6801-4b28-8812-434b12e23f1b None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:18.619001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 82/173] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:18.625061 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9990538-6801-4b28-8812-434b12e23f1b None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:18.675143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:18.708329 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f08d5-95c7-45c7-aa59-489013ab59fa None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:18.743353 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013f4dd-2455-476b-835a-f4e793538d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:18.743924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013f4dd-2455-476b-835a-f4e793538d2c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:18.744209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013f4dd-2455-476b-835a-f4e793538d2c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:18.744491 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013f4dd-2455-476b-835a-f4e793538d2c None admin] PATH_INFO: `/v3/users/daabac9b68d84dcdb04232880864f2ca` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:18.745683 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013f4dd-2455-476b-835a-f4e793538d2c None admin] RBAC: Authorizing `identity:get_user(user_id=daabac9b68d84dcdb04232880864f2ca)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:18.747172 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013f4dd-2455-476b-835a-f4e793538d2c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:18.748778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 92/174] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:18 2022] GET /identity/v3/users/daabac9b68d84dcdb04232880864f2ca => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:18.755294 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013f4dd-2455-476b-835a-f4e793538d2c None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:18.864009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013f4dd-2455-476b-835a-f4e793538d2c None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:18.899595 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f062e6-73d3-4ff1-aa90-7ea99208418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:18.900219 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f062e6-73d3-4ff1-aa90-7ea99208418a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:18.900503 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f062e6-73d3-4ff1-aa90-7ea99208418a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:18.900784 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f062e6-73d3-4ff1-aa90-7ea99208418a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:18.932746 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9990538-6801-4b28-8812-434b12e23f1b None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:18.937424 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:18.974923 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f062e6-73d3-4ff1-aa90-7ea99208418a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:18.974923 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f062e6-73d3-4ff1-aa90-7ea99208418a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:19.040011 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a64a2-b455-4d50-96bc-09dbd9968734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:19.040679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a64a2-b455-4d50-96bc-09dbd9968734 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:19.040968 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a64a2-b455-4d50-96bc-09dbd9968734 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:19.041252 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a64a2-b455-4d50-96bc-09dbd9968734 None admin] PATH_INFO: `/v3/users/fc39e66b7e194e958d72d1dd99cb493e` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:19.042442 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a64a2-b455-4d50-96bc-09dbd9968734 None admin] RBAC: Authorizing `identity:get_user(user_id=fc39e66b7e194e958d72d1dd99cb493e)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:19.043935 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a64a2-b455-4d50-96bc-09dbd9968734 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:19.045736 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 83/175] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:18 2022] GET /identity/v3/users/fc39e66b7e194e958d72d1dd99cb493e => generated 289 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:19.051610 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a64a2-b455-4d50-96bc-09dbd9968734 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:19.112130 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:19.115672 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 93/176] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:19.123313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f062e6-73d3-4ff1-aa90-7ea99208418a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:19.174541 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:19.204542 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a64a2-b455-4d50-96bc-09dbd9968734 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:19.242573 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58798714-a1f4-4575-b6aa-9ab5bb88f7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:19.243606 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58798714-a1f4-4575-b6aa-9ab5bb88f7ca None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:19.243967 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f062e6-73d3-4ff1-aa90-7ea99208418a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:19.244321 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58798714-a1f4-4575-b6aa-9ab5bb88f7ca None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:19.244785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58798714-a1f4-4575-b6aa-9ab5bb88f7ca None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:19.246582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58798714-a1f4-4575-b6aa-9ab5bb88f7ca None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:19.248311 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58798714-a1f4-4575-b6aa-9ab5bb88f7ca None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:19.255146 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 84/177] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:19 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:19.266910 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58798714-a1f4-4575-b6aa-9ab5bb88f7ca None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:19.319258 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ef546-84ff-43fb-918e-3b2ee91aaa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:19.320226 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ef546-84ff-43fb-918e-3b2ee91aaa24 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:19.320752 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ef546-84ff-43fb-918e-3b2ee91aaa24 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:19.321935 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ef546-84ff-43fb-918e-3b2ee91aaa24 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:19.324735 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ef546-84ff-43fb-918e-3b2ee91aaa24 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:19.326375 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ef546-84ff-43fb-918e-3b2ee91aaa24 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:19.333103 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 94/178] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:19 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:19.338050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ef546-84ff-43fb-918e-3b2ee91aaa24 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:19.455123 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:19.459413 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58798714-a1f4-4575-b6aa-9ab5bb88f7ca None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:19.526344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d55e6-cdd5-47e8-a01a-36c05ec5b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:19.528643 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d55e6-cdd5-47e8-a01a-36c05ec5b8d5 None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:19.530055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d55e6-cdd5-47e8-a01a-36c05ec5b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:19.531245 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d55e6-cdd5-47e8-a01a-36c05ec5b8d5 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d/users/fc39e66b7e194e958d72d1dd99cb493e/roles/d468e85ca7384bef9a2e312a37b543fa` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:19.534184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d55e6-cdd5-47e8-a01a-36c05ec5b8d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c21bfcd3302f46909780c42e4b2d702d, user_id=fc39e66b7e194e958d72d1dd99cb493e, role_id=d468e85ca7384bef9a2e312a37b543fa)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:19.536720 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d55e6-cdd5-47e8-a01a-36c05ec5b8d5 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:19.544803 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ef546-84ff-43fb-918e-3b2ee91aaa24 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:19.548898 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:19.568365 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 85/179] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:58:19 2022] PUT /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d/users/fc39e66b7e194e958d72d1dd99cb493e/roles/d468e85ca7384bef9a2e312a37b543fa => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:58:19.602349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6021af-64a0-4cc6-a87a-77acc06fc2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:19.603370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6021af-64a0-4cc6-a87a-77acc06fc2f2 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:19.603893 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6021af-64a0-4cc6-a87a-77acc06fc2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:19.604355 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6021af-64a0-4cc6-a87a-77acc06fc2f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:19.605385 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6021af-64a0-4cc6-a87a-77acc06fc2f2 None admin] RBAC: Adding query filter params (role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa, scope.project.id=c21bfcd3302f46909780c42e4b2d702d, user.id=daabac9b68d84dcdb04232880864f2ca) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:19.605934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6021af-64a0-4cc6-a87a-77acc06fc2f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:19.607683 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6021af-64a0-4cc6-a87a-77acc06fc2f2 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:19.617925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 95/180] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:19 2022] GET /identity/v3/role_assignments?user.id=daabac9b68d84dcdb04232880864f2ca&scope.project.id=c21bfcd3302f46909780c42e4b2d702d&role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:19.927583 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfda63-ca41-4d3d-94c6-772c2d91d46f None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:19.927918 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfda63-ca41-4d3d-94c6-772c2d91d46f None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:19.928109 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfda63-ca41-4d3d-94c6-772c2d91d46f None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:19.929949 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 86/181] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:19.935881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b694df-3233-43f6-8e59-91cce68146f2 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:19.936383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b694df-3233-43f6-8e59-91cce68146f2 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:19.936473 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b694df-3233-43f6-8e59-91cce68146f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:19.956994 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-23b694df-3233-43f6-8e59-91cce68146f2 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:19.958227 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-23b694df-3233-43f6-8e59-91cce68146f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:20.034964 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 96/182] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:20.059882 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfda63-ca41-4d3d-94c6-772c2d91d46f None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:20.132515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432f065-c58f-47b5-8a26-74bca908bccd None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:20.132864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432f065-c58f-47b5-8a26-74bca908bccd None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:20.133079 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432f065-c58f-47b5-8a26-74bca908bccd None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:20.134426 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 97/183] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:20.139405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110147d7-76a2-4b37-9612-55d12e5bc5f3 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:20.139692 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110147d7-76a2-4b37-9612-55d12e5bc5f3 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:20.140527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110147d7-76a2-4b37-9612-55d12e5bc5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:20.167648 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-110147d7-76a2-4b37-9612-55d12e5bc5f3 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:20.168842 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-110147d7-76a2-4b37-9612-55d12e5bc5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:20.178691 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfda63-ca41-4d3d-94c6-772c2d91d46f None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:20.220256 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d483-4f62-4cd1-908c-1c000fd08b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:20.220941 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d483-4f62-4cd1-908c-1c000fd08b48 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:20.221228 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d483-4f62-4cd1-908c-1c000fd08b48 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:20.221512 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d483-4f62-4cd1-908c-1c000fd08b48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:20.235279 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493d483-4f62-4cd1-908c-1c000fd08b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-b493d483-4f62-4cd1-908c-1c000fd08b48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:20.240799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:20.241706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:20.242477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 87/184] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:20.248095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d483-4f62-4cd1-908c-1c000fd08b48 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:20.275101 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:20.288997 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 98/185] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:20.315458 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110147d7-76a2-4b37-9612-55d12e5bc5f3 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:20.345587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:20.388911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d483-4f62-4cd1-908c-1c000fd08b48 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:20.423620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110147d7-76a2-4b37-9612-55d12e5bc5f3 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:20.425027 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35ad22-3b02-4574-9a33-c674d815e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:20.425643 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35ad22-3b02-4574-9a33-c674d815e103 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:20.426556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35ad22-3b02-4574-9a33-c674d815e103 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:20.426556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35ad22-3b02-4574-9a33-c674d815e103 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:20.426912 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35ad22-3b02-4574-9a33-c674d815e103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:20.427216 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35ad22-3b02-4574-9a33-c674d815e103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:20.428595 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35ad22-3b02-4574-9a33-c674d815e103 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:20.442095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 88/186] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:20.442095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd469df-6964-4460-b1aa-95c3dcb0f397 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:20.442095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd469df-6964-4460-b1aa-95c3dcb0f397 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:20.442095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd469df-6964-4460-b1aa-95c3dcb0f397 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:20.442095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 89/187] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:20.445006 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd469df-6964-4460-b1aa-95c3dcb0f397 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:20.466913 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28645875-84f6-4ea2-acb4-204fac6a2f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:20.467659 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28645875-84f6-4ea2-acb4-204fac6a2f3e None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:20.468577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28645875-84f6-4ea2-acb4-204fac6a2f3e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:20.468874 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28645875-84f6-4ea2-acb4-204fac6a2f3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:20.479304 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28645875-84f6-4ea2-acb4-204fac6a2f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-28645875-84f6-4ea2-acb4-204fac6a2f3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:20.484449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:20.485312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:20.486175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 99/188] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:58:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:20.487350 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2309d9-2d85-48ed-a6da-e0368fbecfeb None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:20.487350 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2309d9-2d85-48ed-a6da-e0368fbecfeb None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:20.487513 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2309d9-2d85-48ed-a6da-e0368fbecfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:20.505740 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-be2309d9-2d85-48ed-a6da-e0368fbecfeb None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:20.506967 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-be2309d9-2d85-48ed-a6da-e0368fbecfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:20.536234 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:20.560950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd469df-6964-4460-b1aa-95c3dcb0f397 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:20.576580 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 100/189] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:20.578076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2309d9-2d85-48ed-a6da-e0368fbecfeb None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:20.600308 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:20.615997 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92bdb8-c752-4b51-b3e2-b00839bcec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:20.616650 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92bdb8-c752-4b51-b3e2-b00839bcec4f None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:20.616935 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92bdb8-c752-4b51-b3e2-b00839bcec4f None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:20.617215 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92bdb8-c752-4b51-b3e2-b00839bcec4f None admin] PATH_INFO: `/v3/users/6f70fe51c9984b9b883774062f19fe24` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:20.632488 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92bdb8-c752-4b51-b3e2-b00839bcec4f None admin] RBAC: Authorizing `identity:get_user(user_id=6f70fe51c9984b9b883774062f19fe24)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:20.633949 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92bdb8-c752-4b51-b3e2-b00839bcec4f None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:20.640635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 90/190] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:20 2022] GET /identity/v3/users/6f70fe51c9984b9b883774062f19fe24 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:20.640635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92bdb8-c752-4b51-b3e2-b00839bcec4f None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:20.692644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2309d9-2d85-48ed-a6da-e0368fbecfeb None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:20.729634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1163bcc-0b55-4c06-a949-5bf11ecfe051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:20.730585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1163bcc-0b55-4c06-a949-5bf11ecfe051 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:20.731069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1163bcc-0b55-4c06-a949-5bf11ecfe051 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:20.731493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1163bcc-0b55-4c06-a949-5bf11ecfe051 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:20.732347 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1163bcc-0b55-4c06-a949-5bf11ecfe051 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:20.732817 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1163bcc-0b55-4c06-a949-5bf11ecfe051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:20.735147 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1163bcc-0b55-4c06-a949-5bf11ecfe051 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:20.738349 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92bdb8-c752-4b51-b3e2-b00839bcec4f None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:20.744424 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 101/191] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:58:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:20.745364 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1163bcc-0b55-4c06-a949-5bf11ecfe051 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:20.777224 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e8a88-e735-4f7c-817b-7092c2914ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:20.777936 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e8a88-e735-4f7c-817b-7092c2914ecf None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:20.778232 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e8a88-e735-4f7c-817b-7092c2914ecf None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:20.778498 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e8a88-e735-4f7c-817b-7092c2914ecf None admin] PATH_INFO: `/v3/domains/default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:20.779675 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e8a88-e735-4f7c-817b-7092c2914ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:20.781177 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e8a88-e735-4f7c-817b-7092c2914ecf None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:20.782964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 91/192] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:20.787908 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e8a88-e735-4f7c-817b-7092c2914ecf None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:20.792514 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:20.836272 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:20.856306 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1163bcc-0b55-4c06-a949-5bf11ecfe051 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:20.893560 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6a97a-48e0-4744-8f46-72e5d9752f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:20.894185 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6a97a-48e0-4744-8f46-72e5d9752f39 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:20.894367 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e8a88-e735-4f7c-817b-7092c2914ecf None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:20.894466 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6a97a-48e0-4744-8f46-72e5d9752f39 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:20.894762 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6a97a-48e0-4744-8f46-72e5d9752f39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:20.931597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59d62c-bf04-4b34-857e-c99d222c99c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:20.932260 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59d62c-bf04-4b34-857e-c99d222c99c2 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:20.932543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59d62c-bf04-4b34-857e-c99d222c99c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:20.932817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59d62c-bf04-4b34-857e-c99d222c99c2 None admin] PATH_INFO: `/v3/users/6f70fe51c9984b9b883774062f19fe24` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:20.934086 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59d62c-bf04-4b34-857e-c99d222c99c2 None admin] RBAC: Authorizing `identity:get_user(user_id=6f70fe51c9984b9b883774062f19fe24)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:20.935634 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59d62c-bf04-4b34-857e-c99d222c99c2 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:20.942063 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 92/193] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:20 2022] GET /identity/v3/users/6f70fe51c9984b9b883774062f19fe24 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:20.942063 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59d62c-bf04-4b34-857e-c99d222c99c2 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:20.972141 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6a97a-48e0-4744-8f46-72e5d9752f39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:20.972984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6a97a-48e0-4744-8f46-72e5d9752f39 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:21.031391 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:21.064073 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:21.070349 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59d62c-bf04-4b34-857e-c99d222c99c2 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:21.085823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 102/194] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:21.091560 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6a97a-48e0-4744-8f46-72e5d9752f39 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:21.107772 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02db433-2e66-43e4-8b8d-71641f49490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:21.108761 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02db433-2e66-43e4-8b8d-71641f49490c None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:21.109272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02db433-2e66-43e4-8b8d-71641f49490c None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:21.109272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02db433-2e66-43e4-8b8d-71641f49490c None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:21.109938 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02db433-2e66-43e4-8b8d-71641f49490c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:21.111433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02db433-2e66-43e4-8b8d-71641f49490c None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:21.133479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 93/195] 10.222.0.65 () {60 vars in 1132 bytes} [Mon Jul 25 23:58:20 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:58:21.134757 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02db433-2e66-43e4-8b8d-71641f49490c None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:21.233620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6a97a-48e0-4744-8f46-72e5d9752f39 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:21.262206 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02db433-2e66-43e4-8b8d-71641f49490c None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:21.283975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe100954-802d-48b4-8779-c45407774357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:21.284703 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe100954-802d-48b4-8779-c45407774357 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:21.285069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe100954-802d-48b4-8779-c45407774357 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:21.285413 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe100954-802d-48b4-8779-c45407774357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:21.299621 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:21.311411 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca68e34-27e1-423a-9718-cce772326397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:21.312589 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca68e34-27e1-423a-9718-cce772326397 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:21.313035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca68e34-27e1-423a-9718-cce772326397 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:21.313320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca68e34-27e1-423a-9718-cce772326397 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:21.315285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca68e34-27e1-423a-9718-cce772326397 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:21.317259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca68e34-27e1-423a-9718-cce772326397 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:21.320827 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 94/196] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:21 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:21.325527 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca68e34-27e1-423a-9718-cce772326397 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:21.352914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:21.375372 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe100954-802d-48b4-8779-c45407774357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:21.376792 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe100954-802d-48b4-8779-c45407774357 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:21.466394 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca68e34-27e1-423a-9718-cce772326397 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:21.511962 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 103/197] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:21.516208 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba28b21-76d3-4619-9551-898f7a851305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:21.517031 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba28b21-76d3-4619-9551-898f7a851305 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:21.517461 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba28b21-76d3-4619-9551-898f7a851305 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:21.517955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba28b21-76d3-4619-9551-898f7a851305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:21.518948 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe100954-802d-48b4-8779-c45407774357 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:21.519095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba28b21-76d3-4619-9551-898f7a851305 None admin] RBAC: Adding query filter params (role.id=5d947b934e0642c5a4ab00d547ec3fda, scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d, user.id=6f70fe51c9984b9b883774062f19fe24) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:21.519558 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba28b21-76d3-4619-9551-898f7a851305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:21.521162 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba28b21-76d3-4619-9551-898f7a851305 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:21.534877 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 95/198] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:21 2022] GET /identity/v3/role_assignments?user.id=6f70fe51c9984b9b883774062f19fe24&scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d&role.id=5d947b934e0642c5a4ab00d547ec3fda => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:21.620822 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:21.644710 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe100954-802d-48b4-8779-c45407774357 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:21.689052 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8578e-6a44-415f-8bed-38694290aec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:21.689717 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8578e-6a44-415f-8bed-38694290aec0 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:21.689996 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8578e-6a44-415f-8bed-38694290aec0 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:21.690268 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8578e-6a44-415f-8bed-38694290aec0 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:21.691530 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8578e-6a44-415f-8bed-38694290aec0 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:21.692997 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8578e-6a44-415f-8bed-38694290aec0 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:21.695063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 104/199] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:21 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:21.700803 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba28b21-76d3-4619-9551-898f7a851305 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:21.777917 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:21.823107 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba28b21-76d3-4619-9551-898f7a851305 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:21.874864 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113defce-16bb-40e6-9a83-eaad9574dbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:21.875680 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113defce-16bb-40e6-9a83-eaad9574dbd0 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:21.875969 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113defce-16bb-40e6-9a83-eaad9574dbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:21.876253 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113defce-16bb-40e6-9a83-eaad9574dbd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:21.877054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113defce-16bb-40e6-9a83-eaad9574dbd0 None admin] RBAC: Adding query filter params (role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa, scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d, user.id=6f70fe51c9984b9b883774062f19fe24) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:21.877367 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113defce-16bb-40e6-9a83-eaad9574dbd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:21.878874 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113defce-16bb-40e6-9a83-eaad9574dbd0 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:21.885008 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 96/200] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:21 2022] GET /identity/v3/role_assignments?user.id=6f70fe51c9984b9b883774062f19fe24&scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d&role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:22.241548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3174c20-c805-4dd2-addc-f0e5bfcc2daa None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:22.242554 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3174c20-c805-4dd2-addc-f0e5bfcc2daa None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:22.243067 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3174c20-c805-4dd2-addc-f0e5bfcc2daa None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:22.244881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 105/201] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:22.254037 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00741fab-6177-4a04-9945-d9c4216c7b17 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:22.254324 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00741fab-6177-4a04-9945-d9c4216c7b17 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:22.254603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00741fab-6177-4a04-9945-d9c4216c7b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:22.279748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-00741fab-6177-4a04-9945-d9c4216c7b17 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:22.281001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-00741fab-6177-4a04-9945-d9c4216c7b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:22.376462 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 97/202] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:22.424585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3174c20-c805-4dd2-addc-f0e5bfcc2daa None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:22.564330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3174c20-c805-4dd2-addc-f0e5bfcc2daa None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:22.606176 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06785c5-06d8-43c9-ac36-a00562bd715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:22.607236 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06785c5-06d8-43c9-ac36-a00562bd715f None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:22.607736 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06785c5-06d8-43c9-ac36-a00562bd715f None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:22.608223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06785c5-06d8-43c9-ac36-a00562bd715f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:22.624503 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06785c5-06d8-43c9-ac36-a00562bd715f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-e06785c5-06d8-43c9-ac36-a00562bd715f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:22.629780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:22.630642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:22.631453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:22.631453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:22.631453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:22.631453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:22.631453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:22.631453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:22.631453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:22.631453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:22.631453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:22.631453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:22.631453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:22.631453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:22.633812 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 106/203] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:22.639886 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00741fab-6177-4a04-9945-d9c4216c7b17 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:22.725319 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:22.793426 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00741fab-6177-4a04-9945-d9c4216c7b17 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:22.836502 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc901cf-d466-4135-af5d-d561cbe34002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:22.837045 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc901cf-d466-4135-af5d-d561cbe34002 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:22.837325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc901cf-d466-4135-af5d-d561cbe34002 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:22.837598 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc901cf-d466-4135-af5d-d561cbe34002 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:22.838312 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc901cf-d466-4135-af5d-d561cbe34002 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:22.838616 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc901cf-d466-4135-af5d-d561cbe34002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:22.840018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc901cf-d466-4135-af5d-d561cbe34002 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:22.854653 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 98/204] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:22.860920 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06785c5-06d8-43c9-ac36-a00562bd715f None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:22.885214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:23.025246 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06785c5-06d8-43c9-ac36-a00562bd715f None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:23.072617 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3512-80e3-429b-affa-e25bd8dab299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:23.073261 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3512-80e3-429b-affa-e25bd8dab299 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:23.073540 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3512-80e3-429b-affa-e25bd8dab299 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:23.073808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3512-80e3-429b-affa-e25bd8dab299 None admin] PATH_INFO: `/v3/users/fc39e66b7e194e958d72d1dd99cb493e` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:23.075024 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff3512-80e3-429b-affa-e25bd8dab299 None admin] RBAC: Authorizing `identity:get_user(user_id=fc39e66b7e194e958d72d1dd99cb493e)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:23.076475 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff3512-80e3-429b-affa-e25bd8dab299 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:23.078821 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 107/205] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:22 2022] GET /identity/v3/users/fc39e66b7e194e958d72d1dd99cb493e => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:23.087853 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc901cf-d466-4135-af5d-d561cbe34002 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:23.218566 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc901cf-d466-4135-af5d-d561cbe34002 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:23.242678 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:23.265672 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85318a-082c-42d7-9a46-db8451e15ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:23.266309 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85318a-082c-42d7-9a46-db8451e15ef3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:23.266587 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85318a-082c-42d7-9a46-db8451e15ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:23.266885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85318a-082c-42d7-9a46-db8451e15ef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:23.362194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85318a-082c-42d7-9a46-db8451e15ef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:23.363618 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85318a-082c-42d7-9a46-db8451e15ef3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:23.495438 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 99/206] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:23.501213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3512-80e3-429b-affa-e25bd8dab299 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:23.627727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:23.644358 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3512-80e3-429b-affa-e25bd8dab299 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:23.680561 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e00b3d-4c44-48e7-910b-de6eaab4b883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:23.681213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00b3d-4c44-48e7-910b-de6eaab4b883 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:23.681486 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00b3d-4c44-48e7-910b-de6eaab4b883 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:23.681755 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00b3d-4c44-48e7-910b-de6eaab4b883 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:23.682935 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e00b3d-4c44-48e7-910b-de6eaab4b883 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:23.684433 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e00b3d-4c44-48e7-910b-de6eaab4b883 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:23.686263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 108/207] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:23 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:23.692093 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85318a-082c-42d7-9a46-db8451e15ef3 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:23.710228 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:23.821429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85318a-082c-42d7-9a46-db8451e15ef3 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:23.870005 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b668a-2cd9-46a4-a562-153749d19c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:23.870630 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b668a-2cd9-46a4-a562-153749d19c7b None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:23.870935 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b668a-2cd9-46a4-a562-153749d19c7b None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:23.871206 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b668a-2cd9-46a4-a562-153749d19c7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:23.871992 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b668a-2cd9-46a4-a562-153749d19c7b None admin] RBAC: Adding query filter params (role.id=d468e85ca7384bef9a2e312a37b543fa, scope.project.id=c21bfcd3302f46909780c42e4b2d702d, user.id=fc39e66b7e194e958d72d1dd99cb493e) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:23.872298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b668a-2cd9-46a4-a562-153749d19c7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:23.873740 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b668a-2cd9-46a4-a562-153749d19c7b None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:23.880546 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 100/208] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:23 2022] GET /identity/v3/role_assignments?user.id=fc39e66b7e194e958d72d1dd99cb493e&scope.project.id=c21bfcd3302f46909780c42e4b2d702d&role.id=d468e85ca7384bef9a2e312a37b543fa => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:24.008287 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c87292-63dc-4811-9adf-714e0d91b21d None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.008609 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c87292-63dc-4811-9adf-714e0d91b21d None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.008838 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c87292-63dc-4811-9adf-714e0d91b21d None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.010187 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 109/209] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:24.019118 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a760a-797f-4229-a63f-313f2bdc249a None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.019118 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a760a-797f-4229-a63f-313f2bdc249a None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.019118 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a760a-797f-4229-a63f-313f2bdc249a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.042975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-ac0a760a-797f-4229-a63f-313f2bdc249a None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:24.044536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-ac0a760a-797f-4229-a63f-313f2bdc249a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:24.155919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f13b7-9728-4b24-9c2d-d77072497474 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.156267 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f13b7-9728-4b24-9c2d-d77072497474 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.156554 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f13b7-9728-4b24-9c2d-d77072497474 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.157630 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 101/210] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:24.162735 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 110/211] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:24.180637 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d976b-c6f2-45af-833c-11696d8d2582 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.181279 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d976b-c6f2-45af-833c-11696d8d2582 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.181757 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d976b-c6f2-45af-833c-11696d8d2582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.203630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f13b7-9728-4b24-9c2d-d77072497474 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:24.208963 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-a87d976b-c6f2-45af-833c-11696d8d2582 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:24.210464 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-a87d976b-c6f2-45af-833c-11696d8d2582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:24.215855 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:24.306568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 102/212] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:24.332837 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d976b-c6f2-45af-833c-11696d8d2582 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:24.338195 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f13b7-9728-4b24-9c2d-d77072497474 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:24.381820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4be9e-d66e-4715-ac67-f63770564ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:24.382543 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4be9e-d66e-4715-ac67-f63770564ff4 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.382874 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4be9e-d66e-4715-ac67-f63770564ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.384282 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4be9e-d66e-4715-ac67-f63770564ff4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.398636 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4be9e-d66e-4715-ac67-f63770564ff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-5dc4be9e-d66e-4715-ac67-f63770564ff4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:24.405379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:24.406370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:24.407271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:24.407271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:24.407271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:24.407271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:24.407271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:24.407271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:24.407271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:24.407271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:24.407271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:24.407271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:24.407271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:24.407271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:24.409650 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 111/213] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:24.414494 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4be9e-d66e-4715-ac67-f63770564ff4 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:24.418727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:24.469389 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d976b-c6f2-45af-833c-11696d8d2582 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:24.520027 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098bb02-bda9-4b64-9f30-cf9c7b55a1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:24.521099 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098bb02-bda9-4b64-9f30-cf9c7b55a1f0 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.521608 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098bb02-bda9-4b64-9f30-cf9c7b55a1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.522089 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098bb02-bda9-4b64-9f30-cf9c7b55a1f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.523592 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098bb02-bda9-4b64-9f30-cf9c7b55a1f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:24.528094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098bb02-bda9-4b64-9f30-cf9c7b55a1f0 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:24.530842 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 103/214] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:24.532480 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18304ec-d195-4b20-9cc6-3b465df4ca53 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.533009 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18304ec-d195-4b20-9cc6-3b465df4ca53 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.533490 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18304ec-d195-4b20-9cc6-3b465df4ca53 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.535009 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 104/215] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:24.538947 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18304ec-d195-4b20-9cc6-3b465df4ca53 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:24.551045 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:24.558058 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4be9e-d66e-4715-ac67-f63770564ff4 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:24.593230 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49058-6792-4a4d-9801-d5c04a1929e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:24.594044 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49058-6792-4a4d-9801-d5c04a1929e2 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.594505 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49058-6792-4a4d-9801-d5c04a1929e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.594613 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49058-6792-4a4d-9801-d5c04a1929e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.595321 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb49058-6792-4a4d-9801-d5c04a1929e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:24.595625 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb49058-6792-4a4d-9801-d5c04a1929e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:24.597016 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb49058-6792-4a4d-9801-d5c04a1929e2 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:24.605322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 112/216] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:24.608404 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926ebd8-ee72-4110-b38d-8cfc9bf6f178 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.608950 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926ebd8-ee72-4110-b38d-8cfc9bf6f178 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.609949 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926ebd8-ee72-4110-b38d-8cfc9bf6f178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.629055 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-5926ebd8-ee72-4110-b38d-8cfc9bf6f178 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:24.630272 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-5926ebd8-ee72-4110-b38d-8cfc9bf6f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:24.658588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18304ec-d195-4b20-9cc6-3b465df4ca53 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:24.695723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd31a3e-3d07-4ad8-9f83-e2fea8ad16c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:24.696481 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd31a3e-3d07-4ad8-9f83-e2fea8ad16c8 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.696794 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd31a3e-3d07-4ad8-9f83-e2fea8ad16c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.697083 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd31a3e-3d07-4ad8-9f83-e2fea8ad16c8 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.697933 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd31a3e-3d07-4ad8-9f83-e2fea8ad16c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:24.698416 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:24.699241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd31a3e-3d07-4ad8-9f83-e2fea8ad16c8 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:24.710783 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 113/217] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:24.710783 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926ebd8-ee72-4110-b38d-8cfc9bf6f178 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:24.736654 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 105/218] 10.222.0.65 () {60 vars in 1132 bytes} [Mon Jul 25 23:58:24 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:58:24.738421 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd31a3e-3d07-4ad8-9f83-e2fea8ad16c8 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:24.834521 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926ebd8-ee72-4110-b38d-8cfc9bf6f178 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:24.835749 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:24.878422 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b7f15-723f-4d4d-a75b-9ee31f755de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:24.879634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7f15-723f-4d4d-a75b-9ee31f755de0 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.880131 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7f15-723f-4d4d-a75b-9ee31f755de0 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.880651 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7f15-723f-4d4d-a75b-9ee31f755de0 None admin] PATH_INFO: `/v3/users/2b881c719c2c408aadfda6e9a79881a8` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.894520 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd31a3e-3d07-4ad8-9f83-e2fea8ad16c8 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:24.898029 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b7f15-723f-4d4d-a75b-9ee31f755de0 None admin] RBAC: Authorizing `identity:get_user(user_id=2b881c719c2c408aadfda6e9a79881a8)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:24.899906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b7f15-723f-4d4d-a75b-9ee31f755de0 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:24.907039 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 114/219] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:24 2022] GET /identity/v3/users/2b881c719c2c408aadfda6e9a79881a8 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:24.907039 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff75064-f6f5-436b-8bfe-3715e99c53e5 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.907039 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff75064-f6f5-436b-8bfe-3715e99c53e5 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.907039 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff75064-f6f5-436b-8bfe-3715e99c53e5 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.907039 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 115/220] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:24.911764 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff75064-f6f5-436b-8bfe-3715e99c53e5 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:24.938674 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4271955-ab94-466c-a1d1-dd805f8c4ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:24.939652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4271955-ab94-466c-a1d1-dd805f8c4ba8 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.939940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4271955-ab94-466c-a1d1-dd805f8c4ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.940219 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4271955-ab94-466c-a1d1-dd805f8c4ba8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.953987 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4271955-ab94-466c-a1d1-dd805f8c4ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-c4271955-ab94-466c-a1d1-dd805f8c4ba8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:24.959696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:24.960575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:24.961354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 106/221] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:58:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:24.962509 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bfd58-adf4-475b-a67d-b26334de31e5 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:24.963117 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bfd58-adf4-475b-a67d-b26334de31e5 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:24.963405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bfd58-adf4-475b-a67d-b26334de31e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:24.982001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-d32bfd58-adf4-475b-a67d-b26334de31e5 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:24.983284 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-d32bfd58-adf4-475b-a67d-b26334de31e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:24.992216 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:25.050823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff75064-f6f5-436b-8bfe-3715e99c53e5 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:25.068539 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 107/222] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:25.069731 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bfd58-adf4-475b-a67d-b26334de31e5 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:25.099656 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627a81-e8c0-424b-b02e-3eee8d471908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:25.100352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627a81-e8c0-424b-b02e-3eee8d471908 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:25.100642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627a81-e8c0-424b-b02e-3eee8d471908 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:25.101006 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72627a81-e8c0-424b-b02e-3eee8d471908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:25.139585 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:25.194601 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72627a81-e8c0-424b-b02e-3eee8d471908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:25.194939 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bfd58-adf4-475b-a67d-b26334de31e5 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:25.196736 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72627a81-e8c0-424b-b02e-3eee8d471908 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:25.233868 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db6dfb-e4b5-43c8-be52-1a75a55018b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:25.235217 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db6dfb-e4b5-43c8-be52-1a75a55018b0 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:25.235601 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db6dfb-e4b5-43c8-be52-1a75a55018b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:25.236033 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db6dfb-e4b5-43c8-be52-1a75a55018b0 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:25.236947 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db6dfb-e4b5-43c8-be52-1a75a55018b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:25.237381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db6dfb-e4b5-43c8-be52-1a75a55018b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:25.239011 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db6dfb-e4b5-43c8-be52-1a75a55018b0 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:25.253559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 108/223] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:25.254627 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db6dfb-e4b5-43c8-be52-1a75a55018b0 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:25.268364 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:25.331273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 116/224] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:25.335885 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627a81-e8c0-424b-b02e-3eee8d471908 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:25.380069 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db6dfb-e4b5-43c8-be52-1a75a55018b0 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:25.401997 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:25.423467 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ee5c-a8f8-43b9-b31a-9fcff05752ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:25.424114 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ee5c-a8f8-43b9-b31a-9fcff05752ac None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:25.424396 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ee5c-a8f8-43b9-b31a-9fcff05752ac None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:25.424674 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ee5c-a8f8-43b9-b31a-9fcff05752ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:25.437374 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348ee5c-a8f8-43b9-b31a-9fcff05752ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-d348ee5c-a8f8-43b9-b31a-9fcff05752ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:25.442733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:25.443819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:25.444724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 109/225] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:58:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:25.445383 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ee5c-a8f8-43b9-b31a-9fcff05752ac None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:25.471357 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72627a81-e8c0-424b-b02e-3eee8d471908 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:25.521773 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bed97-f10c-404b-b025-a531f8eec4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:25.522833 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bed97-f10c-404b-b025-a531f8eec4c8 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:25.523368 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bed97-f10c-404b-b025-a531f8eec4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:25.523794 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bed97-f10c-404b-b025-a531f8eec4c8 None admin] PATH_INFO: `/v3/users/6f70fe51c9984b9b883774062f19fe24` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:25.526274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bed97-f10c-404b-b025-a531f8eec4c8 None admin] RBAC: Authorizing `identity:get_user(user_id=6f70fe51c9984b9b883774062f19fe24)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:25.528154 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bed97-f10c-404b-b025-a531f8eec4c8 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:25.530251 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 117/226] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:25 2022] GET /identity/v3/users/6f70fe51c9984b9b883774062f19fe24 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:25.531209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bed97-f10c-404b-b025-a531f8eec4c8 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:25.564001 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:25.570677 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ee5c-a8f8-43b9-b31a-9fcff05752ac None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:25.625429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10fbdc-52a4-4766-8abf-39f0d2396245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:25.626365 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10fbdc-52a4-4766-8abf-39f0d2396245 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:25.626833 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10fbdc-52a4-4766-8abf-39f0d2396245 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:25.627747 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10fbdc-52a4-4766-8abf-39f0d2396245 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:25.629515 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10fbdc-52a4-4766-8abf-39f0d2396245 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:25.631725 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10fbdc-52a4-4766-8abf-39f0d2396245 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:25.634334 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 110/227] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:25 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:25.635291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10fbdc-52a4-4766-8abf-39f0d2396245 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:25.660602 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bed97-f10c-404b-b025-a531f8eec4c8 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:25.699370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a89e6-b948-4709-a2ae-4cca8e74c768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:25.700113 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:25.700234 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a89e6-b948-4709-a2ae-4cca8e74c768 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:25.700601 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a89e6-b948-4709-a2ae-4cca8e74c768 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:25.700987 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a89e6-b948-4709-a2ae-4cca8e74c768 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:25.701807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a89e6-b948-4709-a2ae-4cca8e74c768 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:25.703528 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a89e6-b948-4709-a2ae-4cca8e74c768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:25.705025 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a89e6-b948-4709-a2ae-4cca8e74c768 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:25.714579 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 118/228] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:58:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:25.715758 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a89e6-b948-4709-a2ae-4cca8e74c768 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:25.818141 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:25.836891 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a89e6-b948-4709-a2ae-4cca8e74c768 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:25.876787 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c33d12-8a20-48cd-9ff0-12e83d312ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:25.877686 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c33d12-8a20-48cd-9ff0-12e83d312ed0 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:25.878356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c33d12-8a20-48cd-9ff0-12e83d312ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:25.878842 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c33d12-8a20-48cd-9ff0-12e83d312ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:25.880325 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c33d12-8a20-48cd-9ff0-12e83d312ed0 None admin] RBAC: Adding query filter params (role.id=5717836a50094587b879206794e7156a, scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d, user.id=2b881c719c2c408aadfda6e9a79881a8) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:25.880917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c33d12-8a20-48cd-9ff0-12e83d312ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:25.883170 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c33d12-8a20-48cd-9ff0-12e83d312ed0 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:25.891418 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 119/229] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:25 2022] GET /identity/v3/role_assignments?user.id=2b881c719c2c408aadfda6e9a79881a8&scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d&role.id=5717836a50094587b879206794e7156a => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:25.892384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c33d12-8a20-48cd-9ff0-12e83d312ed0 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:25.909914 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10fbdc-52a4-4766-8abf-39f0d2396245 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:26.001168 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ec82-2b98-426c-abbf-9b8d876279ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:26.001991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ec82-2b98-426c-abbf-9b8d876279ff None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:26.002372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ec82-2b98-426c-abbf-9b8d876279ff None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:26.002772 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ec82-2b98-426c-abbf-9b8d876279ff None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:26.007701 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6ec82-2b98-426c-abbf-9b8d876279ff None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:26.009283 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6ec82-2b98-426c-abbf-9b8d876279ff None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:26.011288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 111/230] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:25 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:26.017916 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c33d12-8a20-48cd-9ff0-12e83d312ed0 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:26.020063 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ec82-2b98-426c-abbf-9b8d876279ff None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:26.068102 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fcdd2-c3fe-4f65-83f8-5911d9cee0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:26.069030 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fcdd2-c3fe-4f65-83f8-5911d9cee0dd None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:26.069456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fcdd2-c3fe-4f65-83f8-5911d9cee0dd None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:26.069890 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fcdd2-c3fe-4f65-83f8-5911d9cee0dd None admin] PATH_INFO: `/v3/users/6f70fe51c9984b9b883774062f19fe24` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:26.072186 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fcdd2-c3fe-4f65-83f8-5911d9cee0dd None admin] RBAC: Authorizing `identity:get_user(user_id=6f70fe51c9984b9b883774062f19fe24)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:26.074088 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fcdd2-c3fe-4f65-83f8-5911d9cee0dd None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:26.076649 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 120/231] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:25 2022] GET /identity/v3/users/6f70fe51c9984b9b883774062f19fe24 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:26.082855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fcdd2-c3fe-4f65-83f8-5911d9cee0dd None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:26.111907 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:26.178008 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ec82-2b98-426c-abbf-9b8d876279ff None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:26.212763 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:26.225468 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fcdd2-c3fe-4f65-83f8-5911d9cee0dd None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:26.235722 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90a99-bcb1-4984-b3a0-a61957cb5132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:26.237049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90a99-bcb1-4984-b3a0-a61957cb5132 None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:26.237334 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90a99-bcb1-4984-b3a0-a61957cb5132 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:26.237612 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90a99-bcb1-4984-b3a0-a61957cb5132 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d/users/6f70fe51c9984b9b883774062f19fe24/roles/5d947b934e0642c5a4ab00d547ec3fda` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:26.239873 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da90a99-bcb1-4984-b3a0-a61957cb5132 None admin] RBAC: Authorizing `identity:create_grant(project_id=589bd0360e7e41baa7c699b6e9e5be9d, user_id=6f70fe51c9984b9b883774062f19fe24, role_id=5d947b934e0642c5a4ab00d547ec3fda)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:26.241299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da90a99-bcb1-4984-b3a0-a61957cb5132 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:26.258485 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 112/232] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:58:26 2022] PUT /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d/users/6f70fe51c9984b9b883774062f19fe24/roles/5d947b934e0642c5a4ab00d547ec3fda => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:58:26.276045 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55570b-518d-47bb-a784-d868c3320d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:26.277194 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55570b-518d-47bb-a784-d868c3320d12 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:26.277626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55570b-518d-47bb-a784-d868c3320d12 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:26.278085 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55570b-518d-47bb-a784-d868c3320d12 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:26.279665 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55570b-518d-47bb-a784-d868c3320d12 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:26.282776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55570b-518d-47bb-a784-d868c3320d12 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:26.285255 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 121/233] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:26 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:26.294802 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90a99-bcb1-4984-b3a0-a61957cb5132 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:26.418595 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90a99-bcb1-4984-b3a0-a61957cb5132 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:26.456686 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7781d-0ee3-4f52-9137-5c29abd15ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:26.457762 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7781d-0ee3-4f52-9137-5c29abd15ce6 None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:26.458048 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7781d-0ee3-4f52-9137-5c29abd15ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:26.458328 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7781d-0ee3-4f52-9137-5c29abd15ce6 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d/users/6f70fe51c9984b9b883774062f19fe24/roles/c88cff91a5454c9ea5c03c9eb0a7a2aa` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:26.460728 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7781d-0ee3-4f52-9137-5c29abd15ce6 None admin] RBAC: Authorizing `identity:create_grant(project_id=589bd0360e7e41baa7c699b6e9e5be9d, user_id=6f70fe51c9984b9b883774062f19fe24, role_id=c88cff91a5454c9ea5c03c9eb0a7a2aa)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:26.462231 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7781d-0ee3-4f52-9137-5c29abd15ce6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:26.480348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 113/234] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:58:26 2022] PUT /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d/users/6f70fe51c9984b9b883774062f19fe24/roles/c88cff91a5454c9ea5c03c9eb0a7a2aa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:58:27.385417 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d44e9-95eb-43bc-ae01-5d8d0b314d78 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:27.386489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d44e9-95eb-43bc-ae01-5d8d0b314d78 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:27.387004 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d44e9-95eb-43bc-ae01-5d8d0b314d78 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:27.388712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 122/235] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:27.394832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9f191-7e80-457d-a5c1-29e6f8e6617a None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:27.395744 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9f191-7e80-457d-a5c1-29e6f8e6617a None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:27.396219 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9f191-7e80-457d-a5c1-29e6f8e6617a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:27.423693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-30c9f191-7e80-457d-a5c1-29e6f8e6617a None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:27.425218 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-30c9f191-7e80-457d-a5c1-29e6f8e6617a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:27.456713 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:27.517223 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 114/236] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:27.563164 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d44e9-95eb-43bc-ae01-5d8d0b314d78 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:27.564354 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212251-698d-4a47-b68f-ffc0d61bf52a None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:27.564652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212251-698d-4a47-b68f-ffc0d61bf52a None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:27.564934 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4212251-698d-4a47-b68f-ffc0d61bf52a None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:27.566442 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 115/237] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:27.571533 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1520f3-2f19-4de4-9872-36d98a5d2ea8 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:27.571826 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1520f3-2f19-4de4-9872-36d98a5d2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:27.572112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1520f3-2f19-4de4-9872-36d98a5d2ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:27.604964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-9b1520f3-2f19-4de4-9872-36d98a5d2ea8 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:27.605300 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-9b1520f3-2f19-4de4-9872-36d98a5d2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:27.691773 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 116/238] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:27.719091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1520f3-2f19-4de4-9872-36d98a5d2ea8 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:27.730955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:27.752118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d44e9-95eb-43bc-ae01-5d8d0b314d78 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:27.821651 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a9d50-4c51-43a1-8aa6-05ac4afe5754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:27.822729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9d50-4c51-43a1-8aa6-05ac4afe5754 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:27.823266 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9d50-4c51-43a1-8aa6-05ac4afe5754 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:27.823736 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a9d50-4c51-43a1-8aa6-05ac4afe5754 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:27.849542 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a9d50-4c51-43a1-8aa6-05ac4afe5754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-443a9d50-4c51-43a1-8aa6-05ac4afe5754 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:27.861376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:27.862242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:27.863065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:27.863065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:27.863065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:27.863065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:27.863065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:27.863065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:27.863065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:27.863065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:27.863065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:27.863065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:27.863065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:27.863065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:27.868041 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 123/239] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:27.875529 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a9d50-4c51-43a1-8aa6-05ac4afe5754 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:27.898742 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:27.901767 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1520f3-2f19-4de4-9872-36d98a5d2ea8 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:27.949790 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb49f2-49fc-44ef-af98-fa4dd19d0578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:27.950414 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb49f2-49fc-44ef-af98-fa4dd19d0578 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:27.950730 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb49f2-49fc-44ef-af98-fa4dd19d0578 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:27.950998 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb49f2-49fc-44ef-af98-fa4dd19d0578 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:27.952323 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb49f2-49fc-44ef-af98-fa4dd19d0578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:27.953767 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb49f2-49fc-44ef-af98-fa4dd19d0578 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:27.955842 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 117/240] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:27.965391 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb49f2-49fc-44ef-af98-fa4dd19d0578 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:28.042226 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a9d50-4c51-43a1-8aa6-05ac4afe5754 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:28.095314 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907146a6-08c9-4c62-a16c-376cd2147d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:28.096234 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907146a6-08c9-4c62-a16c-376cd2147d93 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:28.097212 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907146a6-08c9-4c62-a16c-376cd2147d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:28.097644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907146a6-08c9-4c62-a16c-376cd2147d93 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:28.098538 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907146a6-08c9-4c62-a16c-376cd2147d93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:28.099172 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907146a6-08c9-4c62-a16c-376cd2147d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:28.101073 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907146a6-08c9-4c62-a16c-376cd2147d93 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:28.111815 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 124/241] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:28.118035 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907146a6-08c9-4c62-a16c-376cd2147d93 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:28.140873 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:28.167547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb49f2-49fc-44ef-af98-fa4dd19d0578 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:28.236900 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26087b-ee9b-48c5-9713-d785d6c64291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:28.237508 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26087b-ee9b-48c5-9713-d785d6c64291 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:28.237788 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26087b-ee9b-48c5-9713-d785d6c64291 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:28.238063 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26087b-ee9b-48c5-9713-d785d6c64291 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:28.239490 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26087b-ee9b-48c5-9713-d785d6c64291 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:28.240954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26087b-ee9b-48c5-9713-d785d6c64291 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:28.284607 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 118/242] 10.222.0.65 () {60 vars in 1132 bytes} [Mon Jul 25 23:58:27 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:58:28.319355 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907146a6-08c9-4c62-a16c-376cd2147d93 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:28.369337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed9885-5047-43df-a3f0-354873a6213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:28.370049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9885-5047-43df-a3f0-354873a6213b None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:28.370340 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9885-5047-43df-a3f0-354873a6213b None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:28.370618 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9885-5047-43df-a3f0-354873a6213b None admin] PATH_INFO: `/v3/users/3e2de581fc7a4610b0500cd0782f9cdf` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:28.390726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed9885-5047-43df-a3f0-354873a6213b None admin] RBAC: Authorizing `identity:get_user(user_id=3e2de581fc7a4610b0500cd0782f9cdf)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:28.392221 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed9885-5047-43df-a3f0-354873a6213b None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:28.393946 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 125/243] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:28 2022] GET /identity/v3/users/3e2de581fc7a4610b0500cd0782f9cdf => generated 297 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:28.399547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26087b-ee9b-48c5-9713-d785d6c64291 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:28.420205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:28.512444 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26087b-ee9b-48c5-9713-d785d6c64291 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:28.549829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e5b4d-3cb8-48fd-a0ee-6033216f4ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:28.550468 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e5b4d-3cb8-48fd-a0ee-6033216f4ef9 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:28.550778 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e5b4d-3cb8-48fd-a0ee-6033216f4ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:28.551059 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e5b4d-3cb8-48fd-a0ee-6033216f4ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:28.629427 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e5b4d-3cb8-48fd-a0ee-6033216f4ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:28.631118 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e5b4d-3cb8-48fd-a0ee-6033216f4ef9 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:28.650081 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:28.747914 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 119/244] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:28.754053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed9885-5047-43df-a3f0-354873a6213b None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:28.822684 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1bc87-d1e8-46ad-a9fb-c1806a65c925 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:28.823037 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1bc87-d1e8-46ad-a9fb-c1806a65c925 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:28.823270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1bc87-d1e8-46ad-a9fb-c1806a65c925 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:28.824745 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 120/245] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:28.832819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac057c-b798-4f77-9274-e17fcc5f4ab3 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:28.833110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac057c-b798-4f77-9274-e17fcc5f4ab3 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:28.833482 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac057c-b798-4f77-9274-e17fcc5f4ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:28.839053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:28.864650 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-a6ac057c-b798-4f77-9274-e17fcc5f4ab3 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:28.865855 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-a6ac057c-b798-4f77-9274-e17fcc5f4ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:28.885778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed9885-5047-43df-a3f0-354873a6213b None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:28.958382 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 121/246] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:28.973887 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ada7-76bc-4293-b192-48acca23ad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:28.974961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ada7-76bc-4293-b192-48acca23ad3d None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:28.975444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ada7-76bc-4293-b192-48acca23ad3d None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:28.975914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ada7-76bc-4293-b192-48acca23ad3d None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:28.977327 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991ada7-76bc-4293-b192-48acca23ad3d None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:28.979035 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991ada7-76bc-4293-b192-48acca23ad3d None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:28.981320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 126/247] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:28 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:28.987806 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac057c-b798-4f77-9274-e17fcc5f4ab3 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:28.989223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ada7-76bc-4293-b192-48acca23ad3d None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:29.042153 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:29.142304 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac057c-b798-4f77-9274-e17fcc5f4ab3 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:29.173361 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ada7-76bc-4293-b192-48acca23ad3d None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:29.232191 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7d4c-3b16-47cd-a467-97f424b6fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:29.232843 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7d4c-3b16-47cd-a467-97f424b6fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:29.233669 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7d4c-3b16-47cd-a467-97f424b6fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:29.234542 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7d4c-3b16-47cd-a467-97f424b6fdb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:29.245113 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:29.262653 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ce36-b54d-46c4-b7df-53324ba664e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:29.263624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ce36-b54d-46c4-b7df-53324ba664e6 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:29.264104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ce36-b54d-46c4-b7df-53324ba664e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:29.264672 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ce36-b54d-46c4-b7df-53324ba664e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:29.265683 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562ce36-b54d-46c4-b7df-53324ba664e6 None admin] RBAC: Adding query filter params (role.id=d468e85ca7384bef9a2e312a37b543fa, scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d, user.id=3e2de581fc7a4610b0500cd0782f9cdf) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:29.266215 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562ce36-b54d-46c4-b7df-53324ba664e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:29.267911 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562ce36-b54d-46c4-b7df-53324ba664e6 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:29.268991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f7d4c-3b16-47cd-a467-97f424b6fdb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-279f7d4c-3b16-47cd-a467-97f424b6fdb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:29.276954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:29.279664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:29.281163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:29.281163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:29.281163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:29.281163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:29.281163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:29.281163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:29.281163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:29.281163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:29.281163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:29.281163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:29.281163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:29.281163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:29.284066 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 122/248] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:29.287019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4aa90-b6fa-4998-9a76-64baf680288c None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:29.289731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 127/249] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:28 2022] GET /identity/v3/role_assignments?user.id=3e2de581fc7a4610b0500cd0782f9cdf&scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d&role.id=d468e85ca7384bef9a2e312a37b543fa => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:29.291043 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ce36-b54d-46c4-b7df-53324ba664e6 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:29.291928 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4aa90-b6fa-4998-9a76-64baf680288c None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:29.294934 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4aa90-b6fa-4998-9a76-64baf680288c None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:29.298678 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 123/250] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:29 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:29.303843 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a556481-53b3-49b4-8a37-a48257157bb6 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:29.304128 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a556481-53b3-49b4-8a37-a48257157bb6 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:29.304405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a556481-53b3-49b4-8a37-a48257157bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:29.329170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-4a556481-53b3-49b4-8a37-a48257157bb6 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:29.334746 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-4a556481-53b3-49b4-8a37-a48257157bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:29.412916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 124/251] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:29.455272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a556481-53b3-49b4-8a37-a48257157bb6 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:29.493700 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:29.503457 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ce36-b54d-46c4-b7df-53324ba664e6 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:29.544798 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea637a8b-1620-4e5b-909b-cdc3a28ddd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:29.545903 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea637a8b-1620-4e5b-909b-cdc3a28ddd43 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:29.546427 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea637a8b-1620-4e5b-909b-cdc3a28ddd43 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:29.546992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea637a8b-1620-4e5b-909b-cdc3a28ddd43 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:29.547929 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea637a8b-1620-4e5b-909b-cdc3a28ddd43 None admin] RBAC: Adding query filter params (name=member) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:29.548430 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea637a8b-1620-4e5b-909b-cdc3a28ddd43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:29.550047 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea637a8b-1620-4e5b-909b-cdc3a28ddd43 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:29.562636 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 128/252] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:29.564322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21480883-b6ec-47f4-9df1-03b5e4a311bc None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:29.564951 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21480883-b6ec-47f4-9df1-03b5e4a311bc None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:29.565443 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21480883-b6ec-47f4-9df1-03b5e4a311bc None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:29.571761 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 129/253] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:29.572872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21480883-b6ec-47f4-9df1-03b5e4a311bc None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:29.618443 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a556481-53b3-49b4-8a37-a48257157bb6 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:29.660567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:29.684756 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b3940-2615-4055-b03b-aba702ccd1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:29.685318 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b3940-2615-4055-b03b-aba702ccd1e7 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:29.685598 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b3940-2615-4055-b03b-aba702ccd1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:29.685868 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b3940-2615-4055-b03b-aba702ccd1e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:29.705961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b3940-2615-4055-b03b-aba702ccd1e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-a14b3940-2615-4055-b03b-aba702ccd1e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:29.711405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:29.712259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:29.713064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:29.713064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:29.713064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:29.713064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:29.713064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:29.713064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:29.713064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:29.713064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:29.713064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:29.713064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:29.713064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:29.713064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:29.713662 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 125/254] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:58:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:29.714382 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e05337-a5b4-458f-8ae7-d50f269349da None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:29.716112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e05337-a5b4-458f-8ae7-d50f269349da None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:29.717222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e05337-a5b4-458f-8ae7-d50f269349da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:29.744377 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21480883-b6ec-47f4-9df1-03b5e4a311bc None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:29.756250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-11e05337-a5b4-458f-8ae7-d50f269349da None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:29.757440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-11e05337-a5b4-458f-8ae7-d50f269349da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:29.807130 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7f529-492f-4d61-85a5-375ccf3a6d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:29.808196 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7f529-492f-4d61-85a5-375ccf3a6d53 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:29.808472 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7f529-492f-4d61-85a5-375ccf3a6d53 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:29.808745 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7f529-492f-4d61-85a5-375ccf3a6d53 None admin] PATH_INFO: `/v3/users/2b881c719c2c408aadfda6e9a79881a8` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:29.812367 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7f529-492f-4d61-85a5-375ccf3a6d53 None admin] RBAC: Authorizing `identity:get_user(user_id=2b881c719c2c408aadfda6e9a79881a8)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:29.813838 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7f529-492f-4d61-85a5-375ccf3a6d53 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:29.815996 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 130/255] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:29 2022] GET /identity/v3/users/2b881c719c2c408aadfda6e9a79881a8 => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:29.816601 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7f529-492f-4d61-85a5-375ccf3a6d53 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:29.897441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 126/256] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:29.898125 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e05337-a5b4-458f-8ae7-d50f269349da None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:29.952362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:29.998488 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7f529-492f-4d61-85a5-375ccf3a6d53 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:30.059668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e05337-a5b4-458f-8ae7-d50f269349da None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:30.080459 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:30.100148 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5f6cd-0be5-4379-a21d-b9f930e1f2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:30.100797 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5f6cd-0be5-4379-a21d-b9f930e1f2b7 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:30.101093 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5f6cd-0be5-4379-a21d-b9f930e1f2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:30.101355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5f6cd-0be5-4379-a21d-b9f930e1f2b7 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:30.102501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5f6cd-0be5-4379-a21d-b9f930e1f2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:30.104179 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5f6cd-0be5-4379-a21d-b9f930e1f2b7 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:30.105845 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 127/257] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:29 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:30.106595 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5f6cd-0be5-4379-a21d-b9f930e1f2b7 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:30.111991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad8fbc-db35-46d6-bb5e-3aecb28b8c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:30.112630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8fbc-db35-46d6-bb5e-3aecb28b8c39 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:30.112911 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8fbc-db35-46d6-bb5e-3aecb28b8c39 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:30.113185 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad8fbc-db35-46d6-bb5e-3aecb28b8c39 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:30.113902 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad8fbc-db35-46d6-bb5e-3aecb28b8c39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:30.114207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad8fbc-db35-46d6-bb5e-3aecb28b8c39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:30.115609 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad8fbc-db35-46d6-bb5e-3aecb28b8c39 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:30.138108 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 131/258] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:30.138966 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad8fbc-db35-46d6-bb5e-3aecb28b8c39 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:30.221413 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:30.229399 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5f6cd-0be5-4379-a21d-b9f930e1f2b7 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:30.268960 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21044744-6cfd-43b9-af11-466bd3a12c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:30.275394 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21044744-6cfd-43b9-af11-466bd3a12c95 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:30.276356 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21044744-6cfd-43b9-af11-466bd3a12c95 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:30.276889 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21044744-6cfd-43b9-af11-466bd3a12c95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:30.292054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21044744-6cfd-43b9-af11-466bd3a12c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-21044744-6cfd-43b9-af11-466bd3a12c95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:30.300222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:30.301169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:30.301926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:30.301926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:30.301926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:30.301926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:30.301926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:30.301926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:30.301926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:30.301926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:30.301926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:30.301926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:30.301926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:30.301926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:30.306335 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 128/259] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:58:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:30.309347 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21044744-6cfd-43b9-af11-466bd3a12c95 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:30.402196 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad8fbc-db35-46d6-bb5e-3aecb28b8c39 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:30.440677 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43921f-999f-4e77-8e9d-6373a4f4973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:30.441705 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43921f-999f-4e77-8e9d-6373a4f4973e None admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:30.442213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43921f-999f-4e77-8e9d-6373a4f4973e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:30.442722 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43921f-999f-4e77-8e9d-6373a4f4973e None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d/users/2b881c719c2c408aadfda6e9a79881a8/roles/5717836a50094587b879206794e7156a` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:30.445206 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43921f-999f-4e77-8e9d-6373a4f4973e None admin] RBAC: Authorizing `identity:create_grant(project_id=589bd0360e7e41baa7c699b6e9e5be9d, user_id=2b881c719c2c408aadfda6e9a79881a8, role_id=5717836a50094587b879206794e7156a)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:30.446883 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43921f-999f-4e77-8e9d-6373a4f4973e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:30.478125 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 132/260] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:58:30 2022] PUT /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d/users/2b881c719c2c408aadfda6e9a79881a8/roles/5717836a50094587b879206794e7156a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:58:30.479347 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43921f-999f-4e77-8e9d-6373a4f4973e None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:30.540282 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21044744-6cfd-43b9-af11-466bd3a12c95 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:30.560323 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:30.605119 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d81cd-72b3-4be6-944a-3bbbad3426be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:30.605786 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d81cd-72b3-4be6-944a-3bbbad3426be None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:30.606075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d81cd-72b3-4be6-944a-3bbbad3426be None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:30.606352 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d81cd-72b3-4be6-944a-3bbbad3426be None admin] PATH_INFO: `/v3/users/6f70fe51c9984b9b883774062f19fe24` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:30.611614 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d81cd-72b3-4be6-944a-3bbbad3426be None admin] RBAC: Authorizing `identity:get_user(user_id=6f70fe51c9984b9b883774062f19fe24)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:30.613108 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d81cd-72b3-4be6-944a-3bbbad3426be None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:30.614884 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 129/261] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:30 2022] GET /identity/v3/users/6f70fe51c9984b9b883774062f19fe24 => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:30.620510 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d81cd-72b3-4be6-944a-3bbbad3426be None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:30.623901 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43921f-999f-4e77-8e9d-6373a4f4973e None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:30.662336 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5a622-dbd8-445a-8204-b7001374c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:30.663113 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:30.663973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5a622-dbd8-445a-8204-b7001374c21e None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:30.664488 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5a622-dbd8-445a-8204-b7001374c21e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:30.664983 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5a622-dbd8-445a-8204-b7001374c21e None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:30.666008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5a622-dbd8-445a-8204-b7001374c21e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:30.666475 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5a622-dbd8-445a-8204-b7001374c21e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:30.668302 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5a622-dbd8-445a-8204-b7001374c21e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:30.679044 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 133/262] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:58:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:30.685006 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5a622-dbd8-445a-8204-b7001374c21e None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:30.819438 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d81cd-72b3-4be6-944a-3bbbad3426be None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:30.876584 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80284ad-ea21-432b-b757-9d14ca2125ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:30.877228 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80284ad-ea21-432b-b757-9d14ca2125ad None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:30.877513 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80284ad-ea21-432b-b757-9d14ca2125ad None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:30.877788 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80284ad-ea21-432b-b757-9d14ca2125ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:30.895272 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5a622-dbd8-445a-8204-b7001374c21e None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:30.912537 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:30.996421 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4af5f-5fb9-45fb-b446-60e98afcd0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:30.997086 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4af5f-5fb9-45fb-b446-60e98afcd0c7 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:30.997366 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4af5f-5fb9-45fb-b446-60e98afcd0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:30.997643 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4af5f-5fb9-45fb-b446-60e98afcd0c7 None admin] PATH_INFO: `/v3/users/6f70fe51c9984b9b883774062f19fe24` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:31.003155 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4af5f-5fb9-45fb-b446-60e98afcd0c7 None admin] RBAC: Authorizing `identity:get_user(user_id=6f70fe51c9984b9b883774062f19fe24)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:31.004661 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4af5f-5fb9-45fb-b446-60e98afcd0c7 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:31.006370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 134/263] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:30 2022] GET /identity/v3/users/6f70fe51c9984b9b883774062f19fe24 => generated 283 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:31.015664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4af5f-5fb9-45fb-b446-60e98afcd0c7 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:31.074292 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80284ad-ea21-432b-b757-9d14ca2125ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:31.076180 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80284ad-ea21-432b-b757-9d14ca2125ad None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:31.122838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:31.246435 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4af5f-5fb9-45fb-b446-60e98afcd0c7 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:31.299205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 130/264] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 23:58:31.305105 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80284ad-ea21-432b-b757-9d14ca2125ad None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:31.313106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68712149-71a9-4a0f-ac94-64dda584055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:31.313745 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712149-71a9-4a0f-ac94-64dda584055e None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:31.314030 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712149-71a9-4a0f-ac94-64dda584055e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:31.314312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712149-71a9-4a0f-ac94-64dda584055e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:31.388385 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:31.426175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68712149-71a9-4a0f-ac94-64dda584055e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:31.427704 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68712149-71a9-4a0f-ac94-64dda584055e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:31.510944 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80284ad-ea21-432b-b757-9d14ca2125ad None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:31.531497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 135/265] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:31.541324 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68712149-71a9-4a0f-ac94-64dda584055e None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:31.579130 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:31.586043 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d74d53-066c-44f7-9f61-2a0ced36a593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:31.586700 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d74d53-066c-44f7-9f61-2a0ced36a593 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:31.587049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d74d53-066c-44f7-9f61-2a0ced36a593 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:31.587321 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d74d53-066c-44f7-9f61-2a0ced36a593 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:31.588477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d74d53-066c-44f7-9f61-2a0ced36a593 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:31.589971 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d74d53-066c-44f7-9f61-2a0ced36a593 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:31.592106 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 131/266] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:31 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:31.599204 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d74d53-066c-44f7-9f61-2a0ced36a593 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:31.639243 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:31.652008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68712149-71a9-4a0f-ac94-64dda584055e None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:31.697921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d958ba-db5e-4c26-a5de-58dfffb61509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:31.698567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d958ba-db5e-4c26-a5de-58dfffb61509 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:31.698878 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d958ba-db5e-4c26-a5de-58dfffb61509 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:31.699151 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d958ba-db5e-4c26-a5de-58dfffb61509 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:31.701172 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d958ba-db5e-4c26-a5de-58dfffb61509 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:31.702893 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d958ba-db5e-4c26-a5de-58dfffb61509 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:31.704865 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 136/267] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:31 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:31.713593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d958ba-db5e-4c26-a5de-58dfffb61509 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:31.821747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d958ba-db5e-4c26-a5de-58dfffb61509 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:31.837263 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d74d53-066c-44f7-9f61-2a0ced36a593 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:31.857300 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb8da6-b27a-40db-873c-b34fe3bd15e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:31.858479 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb8da6-b27a-40db-873c-b34fe3bd15e0 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:31.858878 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb8da6-b27a-40db-873c-b34fe3bd15e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:31.859051 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb8da6-b27a-40db-873c-b34fe3bd15e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:31.859832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb8da6-b27a-40db-873c-b34fe3bd15e0 None admin] RBAC: Adding query filter params (role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa, scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d, user.id=6f70fe51c9984b9b883774062f19fe24) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:31.860141 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb8da6-b27a-40db-873c-b34fe3bd15e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:31.861573 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb8da6-b27a-40db-873c-b34fe3bd15e0 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:31.867934 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 137/268] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:31 2022] GET /identity/v3/role_assignments?user.id=6f70fe51c9984b9b883774062f19fe24&scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d&role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:31.918093 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf080b-dc9e-44be-b7ee-e907009a414c None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:31.918373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf080b-dc9e-44be-b7ee-e907009a414c None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:31.918577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf080b-dc9e-44be-b7ee-e907009a414c None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:31.920219 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 138/269] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:31.927518 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6351f9-8775-41e6-9bd0-4c690174281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:31.928566 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6351f9-8775-41e6-9bd0-4c690174281c None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:31.929053 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6351f9-8775-41e6-9bd0-4c690174281c None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:31.929884 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6351f9-8775-41e6-9bd0-4c690174281c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:31.930950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6351f9-8775-41e6-9bd0-4c690174281c None admin] RBAC: Adding query filter params (role.id=5d947b934e0642c5a4ab00d547ec3fda, scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d, user.id=6f70fe51c9984b9b883774062f19fe24) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:31.931492 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6351f9-8775-41e6-9bd0-4c690174281c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:31.933161 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6351f9-8775-41e6-9bd0-4c690174281c None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:31.937535 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6edc3-426f-4dfc-9f49-979e705fb2ba None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:31.937823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6edc3-426f-4dfc-9f49-979e705fb2ba None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:31.938104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6edc3-426f-4dfc-9f49-979e705fb2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:31.946035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 132/270] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:31 2022] GET /identity/v3/role_assignments?user.id=6f70fe51c9984b9b883774062f19fe24&scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d&role.id=5d947b934e0642c5a4ab00d547ec3fda => generated 608 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:31.971598 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-0cc6edc3-426f-4dfc-9f49-979e705fb2ba None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:31.975045 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-0cc6edc3-426f-4dfc-9f49-979e705fb2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:31.980253 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:32.040690 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80952404-5aab-4dc8-9a8d-637eaef87af7 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:32.041360 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80952404-5aab-4dc8-9a8d-637eaef87af7 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:32.041864 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80952404-5aab-4dc8-9a8d-637eaef87af7 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:32.043509 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 133/271] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:32.049801 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca7364-7c7b-48c3-9c6d-d42d8eefbd47 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:32.050480 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca7364-7c7b-48c3-9c6d-d42d8eefbd47 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:32.051022 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca7364-7c7b-48c3-9c6d-d42d8eefbd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:32.087982 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-6bca7364-7c7b-48c3-9c6d-d42d8eefbd47 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:32.089522 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-6bca7364-7c7b-48c3-9c6d-d42d8eefbd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:32.127431 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 139/272] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:32.201469 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6edc3-426f-4dfc-9f49-979e705fb2ba None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:32.203375 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:32.224807 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 134/273] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:32.254229 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca7364-7c7b-48c3-9c6d-d42d8eefbd47 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:32.365500 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6edc3-426f-4dfc-9f49-979e705fb2ba None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:32.406401 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07a944-5633-482b-9c15-bc373d31aa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:32.407092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07a944-5633-482b-9c15-bc373d31aa9a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:32.407378 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07a944-5633-482b-9c15-bc373d31aa9a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:32.407646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07a944-5633-482b-9c15-bc373d31aa9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:32.409329 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07a944-5633-482b-9c15-bc373d31aa9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:32.409454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca7364-7c7b-48c3-9c6d-d42d8eefbd47 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:32.410804 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07a944-5633-482b-9c15-bc373d31aa9a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:32.412783 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 140/274] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:32.415983 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f894-899a-4bce-8ae0-ef6743f6b85f None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:32.415983 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f894-899a-4bce-8ae0-ef6743f6b85f None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:32.415983 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f894-899a-4bce-8ae0-ef6743f6b85f None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:32.421941 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 141/275] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:32.421941 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805f894-899a-4bce-8ae0-ef6743f6b85f None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:32.439715 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:32.451165 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fa535-9be3-45dc-8d9b-87c3dfb0c0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:32.453409 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fa535-9be3-45dc-8d9b-87c3dfb0c0ee None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:32.453631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fa535-9be3-45dc-8d9b-87c3dfb0c0ee None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:32.453915 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fa535-9be3-45dc-8d9b-87c3dfb0c0ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:32.465283 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fa535-9be3-45dc-8d9b-87c3dfb0c0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-2c5fa535-9be3-45dc-8d9b-87c3dfb0c0ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:32.470380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:32.471298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:32.472075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 135/276] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:32.473191 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7b476-dde3-40dc-8fc3-cdf549eddc3a None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:32.473744 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7b476-dde3-40dc-8fc3-cdf549eddc3a None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:32.473744 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7b476-dde3-40dc-8fc3-cdf549eddc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:32.494815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-79a7b476-dde3-40dc-8fc3-cdf549eddc3a None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:32.496027 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-79a7b476-dde3-40dc-8fc3-cdf549eddc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:32.539537 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805f894-899a-4bce-8ae0-ef6743f6b85f None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:32.547708 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:32.577272 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8210b-c738-41a9-931f-ebc10ca1813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:32.578156 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8210b-c738-41a9-931f-ebc10ca1813b None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:32.578434 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8210b-c738-41a9-931f-ebc10ca1813b None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:32.578724 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8210b-c738-41a9-931f-ebc10ca1813b None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:32.579399 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8210b-c738-41a9-931f-ebc10ca1813b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:32.580355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 136/277] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:32.580924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8210b-c738-41a9-931f-ebc10ca1813b None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:32.589457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7b476-dde3-40dc-8fc3-cdf549eddc3a None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:32.606659 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 142/278] 10.222.0.65 () {60 vars in 1132 bytes} [Mon Jul 25 23:58:32 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:58:32.607718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8210b-c738-41a9-931f-ebc10ca1813b None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:32.684045 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:32.725080 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7b476-dde3-40dc-8fc3-cdf549eddc3a None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:32.731344 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8210b-c738-41a9-931f-ebc10ca1813b None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:32.766173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb44bd-f6b4-4158-9103-a0110f30fd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:32.767338 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb44bd-f6b4-4158-9103-a0110f30fd63 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:32.767902 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb44bd-f6b4-4158-9103-a0110f30fd63 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:32.768499 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb44bd-f6b4-4158-9103-a0110f30fd63 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:32.769658 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb44bd-f6b4-4158-9103-a0110f30fd63 None admin] RBAC: Adding query filter params (name=member) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:32.770218 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb44bd-f6b4-4158-9103-a0110f30fd63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:32.770887 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223cc8e-a61f-4083-b4e6-e2d116bc8546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:32.771651 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223cc8e-a61f-4083-b4e6-e2d116bc8546 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:32.772033 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223cc8e-a61f-4083-b4e6-e2d116bc8546 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:32.772336 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb44bd-f6b4-4158-9103-a0110f30fd63 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:32.772456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223cc8e-a61f-4083-b4e6-e2d116bc8546 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:32.785046 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 137/279] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:32.790206 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223cc8e-a61f-4083-b4e6-e2d116bc8546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:32.792548 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb44bd-f6b4-4158-9103-a0110f30fd63 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-d223cc8e-a61f-4083-b4e6-e2d116bc8546 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:32.796312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:32.797213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:32.797995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:32.797995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:32.797995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:32.797995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:32.797995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:32.797995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:32.797995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:32.797995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:32.797995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:32.797995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:32.797995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:32.797995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:32.798584 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 143/280] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:32.805949 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223cc8e-a61f-4083-b4e6-e2d116bc8546 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:32.845058 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:32.937725 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb44bd-f6b4-4158-9103-a0110f30fd63 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:32.945024 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223cc8e-a61f-4083-b4e6-e2d116bc8546 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:32.975746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:32.981034 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b10b2-0b8a-451e-b8d4-6875324f87d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:32.981900 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b10b2-0b8a-451e-b8d4-6875324f87d2 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:32.982323 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b10b2-0b8a-451e-b8d4-6875324f87d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:32.983370 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b10b2-0b8a-451e-b8d4-6875324f87d2 None admin] PATH_INFO: `/v3/users/4467f4fb80db48b5805c27a2e73a64c0` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:32.991348 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f07a8b-f83f-42dd-a9f7-5ebc259b6dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:32.991482 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07a8b-f83f-42dd-a9f7-5ebc259b6dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:32.991691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07a8b-f83f-42dd-a9f7-5ebc259b6dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:32.992449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07a8b-f83f-42dd-a9f7-5ebc259b6dd2 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:32.993557 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f07a8b-f83f-42dd-a9f7-5ebc259b6dd2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:32.994286 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f07a8b-f83f-42dd-a9f7-5ebc259b6dd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:32.996278 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f07a8b-f83f-42dd-a9f7-5ebc259b6dd2 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:33.001193 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b10b2-0b8a-451e-b8d4-6875324f87d2 None admin] RBAC: Authorizing `identity:get_user(user_id=4467f4fb80db48b5805c27a2e73a64c0)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:33.002661 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b10b2-0b8a-451e-b8d4-6875324f87d2 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:33.004693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 138/281] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:32 2022] GET /identity/v3/users/4467f4fb80db48b5805c27a2e73a64c0 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:33.007170 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 144/282] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:33.010289 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b10b2-0b8a-451e-b8d4-6875324f87d2 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:33.012607 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f07a8b-f83f-42dd-a9f7-5ebc259b6dd2 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:33.124097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:33.128558 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b10b2-0b8a-451e-b8d4-6875324f87d2 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:33.140562 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f07a8b-f83f-42dd-a9f7-5ebc259b6dd2 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:33.174032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abeccf-db03-490c-b339-f7f89fd166b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:33.174647 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abeccf-db03-490c-b339-f7f89fd166b6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:33.174949 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abeccf-db03-490c-b339-f7f89fd166b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:33.175220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abeccf-db03-490c-b339-f7f89fd166b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:33.176004 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abeccf-db03-490c-b339-f7f89fd166b6 None admin] RBAC: Adding query filter params (role.id=5717836a50094587b879206794e7156a, user.id=4467f4fb80db48b5805c27a2e73a64c0, scope.system=all) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:33.176308 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abeccf-db03-490c-b339-f7f89fd166b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:33.177751 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abeccf-db03-490c-b339-f7f89fd166b6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:33.183588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 139/283] 10.222.0.65 () {56 vars in 1308 bytes} [Mon Jul 25 23:58:33 2022] GET /identity/v3/role_assignments?user.id=4467f4fb80db48b5805c27a2e73a64c0&scope.system=all&role.id=5717836a50094587b879206794e7156a => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:33.188014 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f10e2f-6cbc-4134-b9b0-b2158948919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:33.189049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f10e2f-6cbc-4134-b9b0-b2158948919c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:33.189537 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f10e2f-6cbc-4134-b9b0-b2158948919c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:33.190019 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f10e2f-6cbc-4134-b9b0-b2158948919c None admin] PATH_INFO: `/v3/users/3e2de581fc7a4610b0500cd0782f9cdf` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:33.191590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f10e2f-6cbc-4134-b9b0-b2158948919c None admin] RBAC: Authorizing `identity:get_user(user_id=3e2de581fc7a4610b0500cd0782f9cdf)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:33.193333 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f10e2f-6cbc-4134-b9b0-b2158948919c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:33.195408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 145/284] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:33 2022] GET /identity/v3/users/3e2de581fc7a4610b0500cd0782f9cdf => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:33.203881 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abeccf-db03-490c-b339-f7f89fd166b6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:33.388013 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abeccf-db03-490c-b339-f7f89fd166b6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:33.430421 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2bbc4-9b11-47fc-8f8a-ce56cd693446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:33.431096 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2bbc4-9b11-47fc-8f8a-ce56cd693446 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:33.431379 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2bbc4-9b11-47fc-8f8a-ce56cd693446 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:33.431655 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2bbc4-9b11-47fc-8f8a-ce56cd693446 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:33.432841 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2bbc4-9b11-47fc-8f8a-ce56cd693446 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:33.434295 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2bbc4-9b11-47fc-8f8a-ce56cd693446 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:33.436984 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 140/285] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:33 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:33.442739 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f10e2f-6cbc-4134-b9b0-b2158948919c None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:33.539723 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:33.598218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f10e2f-6cbc-4134-b9b0-b2158948919c None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:33.633973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3402e-f7ec-40a7-8556-c5447f33c234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:33.634648 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3402e-f7ec-40a7-8556-c5447f33c234 None admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:33.634958 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3402e-f7ec-40a7-8556-c5447f33c234 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:33.635244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3402e-f7ec-40a7-8556-c5447f33c234 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d/users/3e2de581fc7a4610b0500cd0782f9cdf/roles/d468e85ca7384bef9a2e312a37b543fa` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:33.637207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3402e-f7ec-40a7-8556-c5447f33c234 None admin] RBAC: Authorizing `identity:create_grant(project_id=589bd0360e7e41baa7c699b6e9e5be9d, user_id=3e2de581fc7a4610b0500cd0782f9cdf, role_id=d468e85ca7384bef9a2e312a37b543fa)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:33.638747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3402e-f7ec-40a7-8556-c5447f33c234 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:33.675385 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 146/286] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:58:33 2022] PUT /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d/users/3e2de581fc7a4610b0500cd0782f9cdf/roles/d468e85ca7384bef9a2e312a37b543fa => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:58:33.721846 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d5301-e30c-49ea-9442-15d0a1dd631e None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:33.722874 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d5301-e30c-49ea-9442-15d0a1dd631e None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:33.723358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d5301-e30c-49ea-9442-15d0a1dd631e None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:33.725248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 141/287] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:33.731373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b4158-f12f-43fd-a051-6320d5741e27 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:33.731861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b4158-f12f-43fd-a051-6320d5741e27 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:33.731947 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b4158-f12f-43fd-a051-6320d5741e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:33.756936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-468b4158-f12f-43fd-a051-6320d5741e27 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:33.758146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-468b4158-f12f-43fd-a051-6320d5741e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:33.852734 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 147/288] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:33.896589 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d5301-e30c-49ea-9442-15d0a1dd631e None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:33.941902 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:34.044917 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d5301-e30c-49ea-9442-15d0a1dd631e None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:34.081674 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc32006-4ea9-4cc0-b51b-e701aa3d038e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:34.082322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc32006-4ea9-4cc0-b51b-e701aa3d038e None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:34.082600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc32006-4ea9-4cc0-b51b-e701aa3d038e None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:34.082905 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc32006-4ea9-4cc0-b51b-e701aa3d038e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:34.096217 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc32006-4ea9-4cc0-b51b-e701aa3d038e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-6dc32006-4ea9-4cc0-b51b-e701aa3d038e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:34.101102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:34.101967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:34.102752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 142/289] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:34.108308 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b4158-f12f-43fd-a051-6320d5741e27 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:34.167074 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:34.250243 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b4158-f12f-43fd-a051-6320d5741e27 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:34.301203 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38238ce9-9aec-47d3-a666-46c0e2b9d042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:34.302214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38238ce9-9aec-47d3-a666-46c0e2b9d042 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:34.302697 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38238ce9-9aec-47d3-a666-46c0e2b9d042 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:34.303227 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38238ce9-9aec-47d3-a666-46c0e2b9d042 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:34.304196 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38238ce9-9aec-47d3-a666-46c0e2b9d042 None admin] RBAC: Adding query filter params (name=member) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:34.304969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38238ce9-9aec-47d3-a666-46c0e2b9d042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:34.312084 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38238ce9-9aec-47d3-a666-46c0e2b9d042 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:34.321807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 148/290] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:34.327779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc32006-4ea9-4cc0-b51b-e701aa3d038e None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:34.451032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:34.468212 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc32006-4ea9-4cc0-b51b-e701aa3d038e None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:34.505699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf069f6-e6c5-43e1-ac9a-4e1320920114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:34.506336 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf069f6-e6c5-43e1-ac9a-4e1320920114 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:34.506613 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf069f6-e6c5-43e1-ac9a-4e1320920114 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:34.506941 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf069f6-e6c5-43e1-ac9a-4e1320920114 None admin] PATH_INFO: `/v3/users/2b881c719c2c408aadfda6e9a79881a8` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:34.508265 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf069f6-e6c5-43e1-ac9a-4e1320920114 None admin] RBAC: Authorizing `identity:get_user(user_id=2b881c719c2c408aadfda6e9a79881a8)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:34.509692 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf069f6-e6c5-43e1-ac9a-4e1320920114 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:34.511299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 143/291] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:34 2022] GET /identity/v3/users/2b881c719c2c408aadfda6e9a79881a8 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:34.516982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38238ce9-9aec-47d3-a666-46c0e2b9d042 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:34.758523 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38238ce9-9aec-47d3-a666-46c0e2b9d042 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:34.769068 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:34.806371 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c191f-ad8d-4a67-93c0-b162f80c855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:34.807058 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c191f-ad8d-4a67-93c0-b162f80c855b None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:34.807338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c191f-ad8d-4a67-93c0-b162f80c855b None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:34.807609 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c191f-ad8d-4a67-93c0-b162f80c855b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:34.881841 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c191f-ad8d-4a67-93c0-b162f80c855b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:34.883367 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c191f-ad8d-4a67-93c0-b162f80c855b None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:35.006564 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 149/292] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:35.011914 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf069f6-e6c5-43e1-ac9a-4e1320920114 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:35.159977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf069f6-e6c5-43e1-ac9a-4e1320920114 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:35.213409 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cdb6f-ea06-4fd8-a5f9-9a7b4a7e167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:35.214049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cdb6f-ea06-4fd8-a5f9-9a7b4a7e167b None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:35.214327 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cdb6f-ea06-4fd8-a5f9-9a7b4a7e167b None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:35.214601 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cdb6f-ea06-4fd8-a5f9-9a7b4a7e167b None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:35.219446 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cdb6f-ea06-4fd8-a5f9-9a7b4a7e167b None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:35.220908 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cdb6f-ea06-4fd8-a5f9-9a7b4a7e167b None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:35.222991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 144/293] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:35 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:35.228789 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c191f-ad8d-4a67-93c0-b162f80c855b None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:35.237885 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:35.372248 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c191f-ad8d-4a67-93c0-b162f80c855b None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:35.419936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99488f5b-34ff-4b54-820d-f5e42728a29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:35.420818 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99488f5b-34ff-4b54-820d-f5e42728a29e None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:35.421103 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99488f5b-34ff-4b54-820d-f5e42728a29e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:35.421494 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99488f5b-34ff-4b54-820d-f5e42728a29e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:35.422283 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99488f5b-34ff-4b54-820d-f5e42728a29e None admin] RBAC: Adding query filter params (role.id=5717836a50094587b879206794e7156a, scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d, user.id=2b881c719c2c408aadfda6e9a79881a8) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:35.422592 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99488f5b-34ff-4b54-820d-f5e42728a29e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:35.424060 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99488f5b-34ff-4b54-820d-f5e42728a29e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:35.430837 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 150/294] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:35 2022] GET /identity/v3/role_assignments?user.id=2b881c719c2c408aadfda6e9a79881a8&scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d&role.id=5717836a50094587b879206794e7156a => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:35.676938 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b8696-c3ef-4852-a284-0050ad54b2ce None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:35.677138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b8696-c3ef-4852-a284-0050ad54b2ce None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:35.677717 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b8696-c3ef-4852-a284-0050ad54b2ce None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:35.680030 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 145/295] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:35.686414 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e7718-e493-4f69-b504-08646dc64e92 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:35.687233 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e7718-e493-4f69-b504-08646dc64e92 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:35.687727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e7718-e493-4f69-b504-08646dc64e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:35.708515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-e01e7718-e493-4f69-b504-08646dc64e92 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:35.710075 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-e01e7718-e493-4f69-b504-08646dc64e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:35.778693 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:35.790808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 151/296] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:35.810482 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b8696-c3ef-4852-a284-0050ad54b2ce None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:35.838614 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:35.861620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1565e-0788-4528-a28d-2c6ee61e6e59 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:35.861905 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1565e-0788-4528-a28d-2c6ee61e6e59 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:35.862444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1565e-0788-4528-a28d-2c6ee61e6e59 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:35.864095 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 152/297] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:35.870119 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd8ab5-8db3-4251-a6cb-bf9d58415510 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:35.870542 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd8ab5-8db3-4251-a6cb-bf9d58415510 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:35.871055 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd8ab5-8db3-4251-a6cb-bf9d58415510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:35.897388 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-b1fd8ab5-8db3-4251-a6cb-bf9d58415510 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:35.899552 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-b1fd8ab5-8db3-4251-a6cb-bf9d58415510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:35.942732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b8696-c3ef-4852-a284-0050ad54b2ce None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:35.982667 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2b56d-7fd3-4dce-99d3-39da42085d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:35.983708 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2b56d-7fd3-4dce-99d3-39da42085d73 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:35.984188 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2b56d-7fd3-4dce-99d3-39da42085d73 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:35.984666 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2b56d-7fd3-4dce-99d3-39da42085d73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:35.986029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2b56d-7fd3-4dce-99d3-39da42085d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:35.987738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2b56d-7fd3-4dce-99d3-39da42085d73 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:35.989918 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 146/298] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:35.995993 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2b56d-7fd3-4dce-99d3-39da42085d73 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:36.009651 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 153/299] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:36.036525 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027410b-9ff3-4082-99bb-42f9c9be3ec8 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:36.037316 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027410b-9ff3-4082-99bb-42f9c9be3ec8 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:36.038239 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027410b-9ff3-4082-99bb-42f9c9be3ec8 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:36.040372 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 154/300] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:36.041477 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027410b-9ff3-4082-99bb-42f9c9be3ec8 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:36.116975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:36.127111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2b56d-7fd3-4dce-99d3-39da42085d73 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:36.162654 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac19855-b37a-4bcb-8d33-fe7cef7eb863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:36.163316 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac19855-b37a-4bcb-8d33-fe7cef7eb863 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:36.163595 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac19855-b37a-4bcb-8d33-fe7cef7eb863 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:36.163867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac19855-b37a-4bcb-8d33-fe7cef7eb863 None admin] PATH_INFO: `/v3/groups` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:36.164538 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac19855-b37a-4bcb-8d33-fe7cef7eb863 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:36.165976 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac19855-b37a-4bcb-8d33-fe7cef7eb863 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:36.169760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027410b-9ff3-4082-99bb-42f9c9be3ec8 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:36.194117 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 147/301] 10.222.0.65 () {60 vars in 1134 bytes} [Mon Jul 25 23:58:35 2022] POST /identity/v3/groups => generated 229 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:58:36.194117 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14821f45-b95b-4057-992f-05bf89842995 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:36.194117 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14821f45-b95b-4057-992f-05bf89842995 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:36.194117 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14821f45-b95b-4057-992f-05bf89842995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:36.208232 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-14821f45-b95b-4057-992f-05bf89842995 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:36.209742 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-14821f45-b95b-4057-992f-05bf89842995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:36.223196 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:36.229701 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43056d52-976a-4078-a4b2-ab1876d8389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:36.230495 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43056d52-976a-4078-a4b2-ab1876d8389a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:36.230864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43056d52-976a-4078-a4b2-ab1876d8389a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:36.231281 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43056d52-976a-4078-a4b2-ab1876d8389a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:36.244907 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43056d52-976a-4078-a4b2-ab1876d8389a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-43056d52-976a-4078-a4b2-ab1876d8389a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:36.251369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:36.252485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:36.253463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:36.253463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:36.253463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:36.253463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:36.253463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:36.253463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:36.253463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:36.253463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:36.253463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:36.253463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:36.253463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:36.253463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:36.254660 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 155/302] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:36.260211 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43056d52-976a-4078-a4b2-ab1876d8389a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:36.311389 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 148/303] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:36.335288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14821f45-b95b-4057-992f-05bf89842995 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:36.392823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43056d52-976a-4078-a4b2-ab1876d8389a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:36.435207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01d34a-ea73-4f15-b8e8-dd2a0aeb217c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:36.435899 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01d34a-ea73-4f15-b8e8-dd2a0aeb217c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:36.436174 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01d34a-ea73-4f15-b8e8-dd2a0aeb217c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:36.436445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01d34a-ea73-4f15-b8e8-dd2a0aeb217c None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:36.437153 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01d34a-ea73-4f15-b8e8-dd2a0aeb217c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:36.437457 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01d34a-ea73-4f15-b8e8-dd2a0aeb217c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:36.438856 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01d34a-ea73-4f15-b8e8-dd2a0aeb217c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:36.443441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:36.449464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 156/304] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:36.455683 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01d34a-ea73-4f15-b8e8-dd2a0aeb217c None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:36.469628 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14821f45-b95b-4057-992f-05bf89842995 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:36.510512 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd176099-adf6-4807-86a6-fdd3daf62410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:36.511444 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd176099-adf6-4807-86a6-fdd3daf62410 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:36.511879 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd176099-adf6-4807-86a6-fdd3daf62410 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:36.512297 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd176099-adf6-4807-86a6-fdd3daf62410 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:36.523427 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:36.524918 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd176099-adf6-4807-86a6-fdd3daf62410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-cd176099-adf6-4807-86a6-fdd3daf62410 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:36.530184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:36.531287 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:36.532139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:36.532139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:36.532139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:36.532139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:36.532139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:36.532139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:36.532139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:36.532139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:36.532139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:36.532139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:36.532139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:36.532139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:36.534263 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 149/305] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:36.540140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd176099-adf6-4807-86a6-fdd3daf62410 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:36.576021 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01d34a-ea73-4f15-b8e8-dd2a0aeb217c None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:36.614216 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298747b-4273-41ff-9d87-6a0977e2868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:36.614954 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298747b-4273-41ff-9d87-6a0977e2868a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:36.615244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298747b-4273-41ff-9d87-6a0977e2868a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:36.615539 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298747b-4273-41ff-9d87-6a0977e2868a None admin] PATH_INFO: `/v3/users/98cb010ad5de492d9dbe9e3a470a759b` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:36.630958 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298747b-4273-41ff-9d87-6a0977e2868a None admin] RBAC: Authorizing `identity:get_user(user_id=98cb010ad5de492d9dbe9e3a470a759b)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:36.632511 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298747b-4273-41ff-9d87-6a0977e2868a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:36.634254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 157/306] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:36 2022] GET /identity/v3/users/98cb010ad5de492d9dbe9e3a470a759b => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:36.640758 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298747b-4273-41ff-9d87-6a0977e2868a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:36.648747 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd176099-adf6-4807-86a6-fdd3daf62410 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:36.684422 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a76783-c5c7-416a-b0e8-086d61fd7415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:36.685272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76783-c5c7-416a-b0e8-086d61fd7415 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:36.685791 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76783-c5c7-416a-b0e8-086d61fd7415 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:36.686346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76783-c5c7-416a-b0e8-086d61fd7415 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:36.687293 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a76783-c5c7-416a-b0e8-086d61fd7415 None admin] RBAC: Adding query filter params (name=member) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:36.687648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a76783-c5c7-416a-b0e8-086d61fd7415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:36.689045 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a76783-c5c7-416a-b0e8-086d61fd7415 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:36.698213 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 150/307] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:36.704716 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8d7c9-03a7-4409-a1ab-b9e3de2ccff2 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:36.704941 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8d7c9-03a7-4409-a1ab-b9e3de2ccff2 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:36.705216 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8d7c9-03a7-4409-a1ab-b9e3de2ccff2 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:36.706627 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 151/308] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:36.707219 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8d7c9-03a7-4409-a1ab-b9e3de2ccff2 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:36.710091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:36.760589 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298747b-4273-41ff-9d87-6a0977e2868a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:36.777747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:36.801206 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9780199-ec34-4096-8666-69c0cad5f225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:36.801817 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9780199-ec34-4096-8666-69c0cad5f225 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:36.802085 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9780199-ec34-4096-8666-69c0cad5f225 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:36.802362 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9780199-ec34-4096-8666-69c0cad5f225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:36.803167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9780199-ec34-4096-8666-69c0cad5f225 None admin] RBAC: Adding query filter params (role.id=d468e85ca7384bef9a2e312a37b543fa, user.id=98cb010ad5de492d9dbe9e3a470a759b, scope.system=all) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:36.803478 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9780199-ec34-4096-8666-69c0cad5f225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:36.805175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9780199-ec34-4096-8666-69c0cad5f225 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:36.818732 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 158/309] 10.222.0.65 () {56 vars in 1308 bytes} [Mon Jul 25 23:58:36 2022] GET /identity/v3/role_assignments?user.id=98cb010ad5de492d9dbe9e3a470a759b&scope.system=all&role.id=d468e85ca7384bef9a2e312a37b543fa => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:36.818732 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae20f5-e1a2-46e5-a8a0-b3c87f0ab785 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:36.818732 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae20f5-e1a2-46e5-a8a0-b3c87f0ab785 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:36.818732 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae20f5-e1a2-46e5-a8a0-b3c87f0ab785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:36.830053 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8d7c9-03a7-4409-a1ab-b9e3de2ccff2 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:36.833824 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-9aae20f5-e1a2-46e5-a8a0-b3c87f0ab785 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:36.835084 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-9aae20f5-e1a2-46e5-a8a0-b3c87f0ab785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:36.879830 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c2472-9eab-489c-b2bd-9ce5281161e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:36.880886 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2472-9eab-489c-b2bd-9ce5281161e6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:36.881370 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2472-9eab-489c-b2bd-9ce5281161e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:36.881854 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2472-9eab-489c-b2bd-9ce5281161e6 None admin] PATH_INFO: `/v3/users/4467f4fb80db48b5805c27a2e73a64c0` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:36.886750 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c2472-9eab-489c-b2bd-9ce5281161e6 None admin] RBAC: Authorizing `identity:get_user(user_id=4467f4fb80db48b5805c27a2e73a64c0)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:36.891172 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c2472-9eab-489c-b2bd-9ce5281161e6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:36.894026 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 152/310] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:36 2022] GET /identity/v3/users/4467f4fb80db48b5805c27a2e73a64c0 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:36.899668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c2472-9eab-489c-b2bd-9ce5281161e6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:36.930905 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 159/311] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:36.957692 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae20f5-e1a2-46e5-a8a0-b3c87f0ab785 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:37.004239 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:37.039978 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c2472-9eab-489c-b2bd-9ce5281161e6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:37.073328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae20f5-e1a2-46e5-a8a0-b3c87f0ab785 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:37.077907 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5472b2-3f6b-49f3-ad9b-b16d7f9c1961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:37.078886 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5472b2-3f6b-49f3-ad9b-b16d7f9c1961 None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:37.079400 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5472b2-3f6b-49f3-ad9b-b16d7f9c1961 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:37.079879 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5472b2-3f6b-49f3-ad9b-b16d7f9c1961 None admin] PATH_INFO: `/v3/system/users/4467f4fb80db48b5805c27a2e73a64c0/roles/5717836a50094587b879206794e7156a` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:37.081566 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5472b2-3f6b-49f3-ad9b-b16d7f9c1961 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4467f4fb80db48b5805c27a2e73a64c0, role_id=5717836a50094587b879206794e7156a)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:37.083495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5472b2-3f6b-49f3-ad9b-b16d7f9c1961 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:37.087072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:37.095686 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 153/312] 10.222.0.65 () {58 vars in 1334 bytes} [Mon Jul 25 23:58:36 2022] PUT /identity/v3/system/users/4467f4fb80db48b5805c27a2e73a64c0/roles/5717836a50094587b879206794e7156a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:58:37.128580 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e71a2-a489-4d4c-9b37-8079cd8f4b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:37.129425 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e71a2-a489-4d4c-9b37-8079cd8f4b04 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:37.129814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e71a2-a489-4d4c-9b37-8079cd8f4b04 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:37.130098 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e71a2-a489-4d4c-9b37-8079cd8f4b04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:37.143724 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e71a2-a489-4d4c-9b37-8079cd8f4b04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-7d4e71a2-a489-4d4c-9b37-8079cd8f4b04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:37.149312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:37.150244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:37.151069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 160/313] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:37.159198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5472b2-3f6b-49f3-ad9b-b16d7f9c1961 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:37.274655 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5472b2-3f6b-49f3-ad9b-b16d7f9c1961 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:37.313884 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6863f-9b24-4244-a9b3-81a7148bc2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:37.314510 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6863f-9b24-4244-a9b3-81a7148bc2db None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:37.314826 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6863f-9b24-4244-a9b3-81a7148bc2db None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:37.315111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6863f-9b24-4244-a9b3-81a7148bc2db None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:37.315823 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6863f-9b24-4244-a9b3-81a7148bc2db None admin] RBAC: Adding query filter params (name=reader) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:37.316174 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6863f-9b24-4244-a9b3-81a7148bc2db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:37.317508 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6863f-9b24-4244-a9b3-81a7148bc2db None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:37.319141 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:37.328143 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 154/314] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:37.333589 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e71a2-a489-4d4c-9b37-8079cd8f4b04 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:37.443013 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e71a2-a489-4d4c-9b37-8079cd8f4b04 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:37.478786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6202f-0604-4efc-b726-a77766f58c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:37.479428 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6202f-0604-4efc-b726-a77766f58c75 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:37.479709 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6202f-0604-4efc-b726-a77766f58c75 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:37.480044 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6202f-0604-4efc-b726-a77766f58c75 None admin] PATH_INFO: `/v3/users/3e2de581fc7a4610b0500cd0782f9cdf` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:37.481272 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6202f-0604-4efc-b726-a77766f58c75 None admin] RBAC: Authorizing `identity:get_user(user_id=3e2de581fc7a4610b0500cd0782f9cdf)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:37.483307 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6202f-0604-4efc-b726-a77766f58c75 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:37.485219 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 161/315] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:37 2022] GET /identity/v3/users/3e2de581fc7a4610b0500cd0782f9cdf => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:37.490934 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6863f-9b24-4244-a9b3-81a7148bc2db None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:37.603881 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6863f-9b24-4244-a9b3-81a7148bc2db None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:37.640551 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7204300-752f-40f1-8792-ad272510b09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:37.641177 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204300-752f-40f1-8792-ad272510b09c None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:37.641458 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204300-752f-40f1-8792-ad272510b09c None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:37.641732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204300-752f-40f1-8792-ad272510b09c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:37.708139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:37.714966 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7204300-752f-40f1-8792-ad272510b09c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:37.716557 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7204300-752f-40f1-8792-ad272510b09c None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:37.822196 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 155/316] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:37.827614 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6202f-0604-4efc-b726-a77766f58c75 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:37.862543 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:37.939371 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6202f-0604-4efc-b726-a77766f58c75 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:37.981245 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0dd69-57c6-4461-b8e3-602450293476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:37.981922 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0dd69-57c6-4461-b8e3-602450293476 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:37.982206 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0dd69-57c6-4461-b8e3-602450293476 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:37.988645 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0dd69-57c6-4461-b8e3-602450293476 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:37.989669 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0dd69-57c6-4461-b8e3-602450293476 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:37.991505 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0dd69-57c6-4461-b8e3-602450293476 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:37.993689 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 162/317] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:37 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:38.000401 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7204300-752f-40f1-8792-ad272510b09c None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:38.102059 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:38.109862 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7204300-752f-40f1-8792-ad272510b09c None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:38.146126 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afea7d-669c-491d-aa5a-f1ec495ecfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:38.146666 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afea7d-669c-491d-aa5a-f1ec495ecfca None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:38.146980 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afea7d-669c-491d-aa5a-f1ec495ecfca None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:38.147322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afea7d-669c-491d-aa5a-f1ec495ecfca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:38.148110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afea7d-669c-491d-aa5a-f1ec495ecfca None admin] RBAC: Adding query filter params (role.id=d468e85ca7384bef9a2e312a37b543fa, scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d, user.id=3e2de581fc7a4610b0500cd0782f9cdf) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:38.148422 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afea7d-669c-491d-aa5a-f1ec495ecfca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:38.149861 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afea7d-669c-491d-aa5a-f1ec495ecfca None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:38.157072 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 156/318] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:58:37 2022] GET /identity/v3/role_assignments?user.id=3e2de581fc7a4610b0500cd0782f9cdf&scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d&role.id=d468e85ca7384bef9a2e312a37b543fa => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:38.564795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a24e8-6639-43a0-832b-333779200885 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:38.565097 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a24e8-6639-43a0-832b-333779200885 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:38.565513 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a24e8-6639-43a0-832b-333779200885 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:38.567259 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 163/319] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:38.572153 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c435b0-03eb-4e5c-8278-587115f55497 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:38.572576 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c435b0-03eb-4e5c-8278-587115f55497 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:38.572758 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c435b0-03eb-4e5c-8278-587115f55497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:38.590835 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-a7c435b0-03eb-4e5c-8278-587115f55497 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:38.592638 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-a7c435b0-03eb-4e5c-8278-587115f55497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:38.663701 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 157/320] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:38.687820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a24e8-6639-43a0-832b-333779200885 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:38.786955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:38.792011 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a24e8-6639-43a0-832b-333779200885 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:38.827447 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504bed3-3e4c-43fa-94ad-7f295eab61c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:38.827748 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504bed3-3e4c-43fa-94ad-7f295eab61c1 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:38.828278 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504bed3-3e4c-43fa-94ad-7f295eab61c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:38.828278 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504bed3-3e4c-43fa-94ad-7f295eab61c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:38.829453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504bed3-3e4c-43fa-94ad-7f295eab61c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:38.830965 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504bed3-3e4c-43fa-94ad-7f295eab61c1 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:38.832693 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 164/321] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:38.838086 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c435b0-03eb-4e5c-8278-587115f55497 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:38.929554 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:38.942367 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c435b0-03eb-4e5c-8278-587115f55497 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:38.983319 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180364d-18bd-460a-bb29-27eb171b7760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:38.986398 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180364d-18bd-460a-bb29-27eb171b7760 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:38.986398 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180364d-18bd-460a-bb29-27eb171b7760 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:38.986398 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180364d-18bd-460a-bb29-27eb171b7760 None admin] PATH_INFO: `/v3/groups` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:38.986398 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180364d-18bd-460a-bb29-27eb171b7760 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:38.986827 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180364d-18bd-460a-bb29-27eb171b7760 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:39.010766 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 158/322] 10.222.0.65 () {60 vars in 1134 bytes} [Mon Jul 25 23:58:38 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:58:39.100981 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2fdb-a844-4125-9c0d-8a3fc739c873 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:39.101173 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2fdb-a844-4125-9c0d-8a3fc739c873 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:39.101445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2fdb-a844-4125-9c0d-8a3fc739c873 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:39.103040 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 165/323] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:39.108961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb4d87-8fa0-42f0-b254-9fd9bd819503 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:39.109239 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb4d87-8fa0-42f0-b254-9fd9bd819503 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:39.109436 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb4d87-8fa0-42f0-b254-9fd9bd819503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:39.128623 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-74fb4d87-8fa0-42f0-b254-9fd9bd819503 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:39.129823 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-74fb4d87-8fa0-42f0-b254-9fd9bd819503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:39.201025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 159/324] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:39.224393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf2fdb-a844-4125-9c0d-8a3fc739c873 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:39.352356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf2fdb-a844-4125-9c0d-8a3fc739c873 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:39.394751 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4052d5-3107-442c-b767-4b28f4384bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:39.395681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4052d5-3107-442c-b767-4b28f4384bf9 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:39.396133 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4052d5-3107-442c-b767-4b28f4384bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:39.396575 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4052d5-3107-442c-b767-4b28f4384bf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:39.409464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4052d5-3107-442c-b767-4b28f4384bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-3d4052d5-3107-442c-b767-4b28f4384bf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:39.415461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:39.416318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:39.417104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:39.417104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:39.417104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:39.417104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:39.417104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:39.417104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:39.417104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:39.417104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:39.417104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:39.417104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:39.417104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:39.417104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:39.418535 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 166/325] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:39.425694 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb4d87-8fa0-42f0-b254-9fd9bd819503 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:39.514979 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:39.521287 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68efe4-6fad-4bac-8d0d-bf4537183151 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:39.521903 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68efe4-6fad-4bac-8d0d-bf4537183151 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:39.522383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68efe4-6fad-4bac-8d0d-bf4537183151 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:39.524236 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 167/326] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:39.532166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe38c8-5b51-46e1-bb62-30e2756e7b99 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:39.532884 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe38c8-5b51-46e1-bb62-30e2756e7b99 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:39.533686 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe38c8-5b51-46e1-bb62-30e2756e7b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:39.539534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb4d87-8fa0-42f0-b254-9fd9bd819503 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:39.559926 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-4afe38c8-5b51-46e1-bb62-30e2756e7b99 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:39.561373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-4afe38c8-5b51-46e1-bb62-30e2756e7b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:39.581598 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034557d-bf61-49ff-b170-d0e92e0c3539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:39.582254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034557d-bf61-49ff-b170-d0e92e0c3539 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:39.582511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034557d-bf61-49ff-b170-d0e92e0c3539 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:39.582816 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034557d-bf61-49ff-b170-d0e92e0c3539 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:39.583544 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034557d-bf61-49ff-b170-d0e92e0c3539 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:39.583856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034557d-bf61-49ff-b170-d0e92e0c3539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:39.585249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034557d-bf61-49ff-b170-d0e92e0c3539 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:39.596446 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:39.599636 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 160/327] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:39.605275 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034557d-bf61-49ff-b170-d0e92e0c3539 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:39.658884 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 168/328] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:39.682673 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe38c8-5b51-46e1-bb62-30e2756e7b99 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:39.734869 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034557d-bf61-49ff-b170-d0e92e0c3539 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:39.781289 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950c3ee-77b2-4609-8f57-86034af3f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:39.782304 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950c3ee-77b2-4609-8f57-86034af3f4e5 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:39.783050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950c3ee-77b2-4609-8f57-86034af3f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:39.783996 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950c3ee-77b2-4609-8f57-86034af3f4e5 None admin] PATH_INFO: `/v3/users/98cb010ad5de492d9dbe9e3a470a759b` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:39.785614 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950c3ee-77b2-4609-8f57-86034af3f4e5 None admin] RBAC: Authorizing `identity:get_user(user_id=98cb010ad5de492d9dbe9e3a470a759b)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:39.787937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950c3ee-77b2-4609-8f57-86034af3f4e5 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:39.790232 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 161/329] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:39 2022] GET /identity/v3/users/98cb010ad5de492d9dbe9e3a470a759b => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:39.796913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950c3ee-77b2-4609-8f57-86034af3f4e5 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:39.809728 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe38c8-5b51-46e1-bb62-30e2756e7b99 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:39.815909 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:39.851569 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926771dc-13b3-4ecc-a95a-e3966d0bb1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:39.852216 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926771dc-13b3-4ecc-a95a-e3966d0bb1cc None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:39.852478 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926771dc-13b3-4ecc-a95a-e3966d0bb1cc None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:39.852749 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926771dc-13b3-4ecc-a95a-e3966d0bb1cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:39.866219 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926771dc-13b3-4ecc-a95a-e3966d0bb1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-926771dc-13b3-4ecc-a95a-e3966d0bb1cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:39.871339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:39.872214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:39.873091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:39.873091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:39.873091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:39.873091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:39.873091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:39.873091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:39.873091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:39.873091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:39.873091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:39.873091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:39.873091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:39.873091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:39.877397 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 169/330] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:39.878875 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926771dc-13b3-4ecc-a95a-e3966d0bb1cc None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:39.901094 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:39.940114 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950c3ee-77b2-4609-8f57-86034af3f4e5 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:39.985431 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ac2cf-e495-45e5-8e64-53f93fa75ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:39.986441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ac2cf-e495-45e5-8e64-53f93fa75ac1 None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:39.986996 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ac2cf-e495-45e5-8e64-53f93fa75ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:39.987728 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ac2cf-e495-45e5-8e64-53f93fa75ac1 None admin] PATH_INFO: `/v3/system/users/98cb010ad5de492d9dbe9e3a470a759b/roles/d468e85ca7384bef9a2e312a37b543fa` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:39.990121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ac2cf-e495-45e5-8e64-53f93fa75ac1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=98cb010ad5de492d9dbe9e3a470a759b, role_id=d468e85ca7384bef9a2e312a37b543fa)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:39.991835 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ac2cf-e495-45e5-8e64-53f93fa75ac1 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:40.007982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926771dc-13b3-4ecc-a95a-e3966d0bb1cc None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:40.016006 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 162/331] 10.222.0.65 () {58 vars in 1334 bytes} [Mon Jul 25 23:58:39 2022] PUT /identity/v3/system/users/98cb010ad5de492d9dbe9e3a470a759b/roles/d468e85ca7384bef9a2e312a37b543fa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:58:40.049458 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13195e7-1410-41ec-a564-613c5d984558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:40.050086 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13195e7-1410-41ec-a564-613c5d984558 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:40.050452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13195e7-1410-41ec-a564-613c5d984558 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:40.050746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13195e7-1410-41ec-a564-613c5d984558 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:40.051557 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13195e7-1410-41ec-a564-613c5d984558 None admin] RBAC: Adding query filter params (name=member) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:40.051856 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13195e7-1410-41ec-a564-613c5d984558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:40.053428 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13195e7-1410-41ec-a564-613c5d984558 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:40.068743 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 170/332] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:40.070425 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ac2cf-e495-45e5-8e64-53f93fa75ac1 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:40.157767 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:40.193915 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ac2cf-e495-45e5-8e64-53f93fa75ac1 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:40.231355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375ab7e-848b-4d73-b3d6-29c0be35b082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:40.232012 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ab7e-848b-4d73-b3d6-29c0be35b082 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:40.232291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ab7e-848b-4d73-b3d6-29c0be35b082 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:40.232807 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ab7e-848b-4d73-b3d6-29c0be35b082 None admin] PATH_INFO: `/v3/users/4467f4fb80db48b5805c27a2e73a64c0` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:40.234055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375ab7e-848b-4d73-b3d6-29c0be35b082 None admin] RBAC: Authorizing `identity:get_user(user_id=4467f4fb80db48b5805c27a2e73a64c0)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:40.235601 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375ab7e-848b-4d73-b3d6-29c0be35b082 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:40.241067 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 163/333] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:40 2022] GET /identity/v3/users/4467f4fb80db48b5805c27a2e73a64c0 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:40.243784 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13195e7-1410-41ec-a564-613c5d984558 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:40.363248 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:40.388931 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13195e7-1410-41ec-a564-613c5d984558 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:40.428322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208d2fc-61f2-43e7-a4cc-e30504690a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:40.428866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d2fc-61f2-43e7-a4cc-e30504690a56 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:40.429145 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d2fc-61f2-43e7-a4cc-e30504690a56 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:40.429681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d2fc-61f2-43e7-a4cc-e30504690a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:40.430451 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208d2fc-61f2-43e7-a4cc-e30504690a56 None admin] RBAC: Adding query filter params (role.id=5717836a50094587b879206794e7156a, user.id=4467f4fb80db48b5805c27a2e73a64c0, scope.system=all) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:40.430815 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208d2fc-61f2-43e7-a4cc-e30504690a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:40.432238 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208d2fc-61f2-43e7-a4cc-e30504690a56 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:40.447962 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 171/334] 10.222.0.65 () {56 vars in 1308 bytes} [Mon Jul 25 23:58:40 2022] GET /identity/v3/role_assignments?user.id=4467f4fb80db48b5805c27a2e73a64c0&scope.system=all&role.id=5717836a50094587b879206794e7156a => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:42.016477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bc989-3143-4732-b882-fd5be665c839 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:42.016976 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bc989-3143-4732-b882-fd5be665c839 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:42.017049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bc989-3143-4732-b882-fd5be665c839 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:42.018735 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 164/335] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:42.024104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdff68-dff5-4191-b4d2-10e8edbade57 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:42.024933 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdff68-dff5-4191-b4d2-10e8edbade57 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:42.025220 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdff68-dff5-4191-b4d2-10e8edbade57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:42.049713 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-a5fdff68-dff5-4191-b4d2-10e8edbade57 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:42.050940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-a5fdff68-dff5-4191-b4d2-10e8edbade57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:42.137845 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 172/336] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:42.177642 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bc989-3143-4732-b882-fd5be665c839 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:42.313023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bc989-3143-4732-b882-fd5be665c839 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:42.365597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0855213-1381-4592-bbd9-4644dbde65b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:42.366251 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0855213-1381-4592-bbd9-4644dbde65b0 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:42.366538 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0855213-1381-4592-bbd9-4644dbde65b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:42.367032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0855213-1381-4592-bbd9-4644dbde65b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:42.388479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0855213-1381-4592-bbd9-4644dbde65b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-a0855213-1381-4592-bbd9-4644dbde65b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:42.394441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:42.395358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:42.396537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 165/337] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:42.401501 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdff68-dff5-4191-b4d2-10e8edbade57 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:42.475263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:42.491598 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db47c9-6953-433e-8ea9-5171a1ef9b60 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:42.492147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db47c9-6953-433e-8ea9-5171a1ef9b60 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:42.492622 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db47c9-6953-433e-8ea9-5171a1ef9b60 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:42.494129 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 166/338] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:42.500175 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b2a97-91a9-4bda-b7a4-4f142b53ce85 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:42.500676 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b2a97-91a9-4bda-b7a4-4f142b53ce85 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:42.501142 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b2a97-91a9-4bda-b7a4-4f142b53ce85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:42.508088 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:42.528266 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-2b2b2a97-91a9-4bda-b7a4-4f142b53ce85 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:42.529830 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-2b2b2a97-91a9-4bda-b7a4-4f142b53ce85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:42.540099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdff68-dff5-4191-b4d2-10e8edbade57 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:42.639519 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cebe62-69ee-408a-8ba0-18ecf6bc5890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:42.640379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cebe62-69ee-408a-8ba0-18ecf6bc5890 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:42.640815 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cebe62-69ee-408a-8ba0-18ecf6bc5890 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:42.641226 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cebe62-69ee-408a-8ba0-18ecf6bc5890 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:42.641431 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 167/339] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:42.642087 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cebe62-69ee-408a-8ba0-18ecf6bc5890 None admin] RBAC: Adding query filter params (name=member) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:42.642493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cebe62-69ee-408a-8ba0-18ecf6bc5890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:42.643984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cebe62-69ee-408a-8ba0-18ecf6bc5890 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:42.653106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 173/340] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:42.660465 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b2a97-91a9-4bda-b7a4-4f142b53ce85 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:42.746552 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cebe62-69ee-408a-8ba0-18ecf6bc5890 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:42.818242 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b2a97-91a9-4bda-b7a4-4f142b53ce85 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:42.866816 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:42.879411 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6991f59-1185-4532-8a53-3ca3205f22f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:42.880049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6991f59-1185-4532-8a53-3ca3205f22f9 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:42.880336 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6991f59-1185-4532-8a53-3ca3205f22f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:42.880614 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6991f59-1185-4532-8a53-3ca3205f22f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:42.909533 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cebe62-69ee-408a-8ba0-18ecf6bc5890 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:42.955611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:42.960124 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e82e4-3f43-443b-8637-e97a3d2ea64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:42.961136 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e82e4-3f43-443b-8637-e97a3d2ea64a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:42.961411 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e82e4-3f43-443b-8637-e97a3d2ea64a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:42.961692 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e82e4-3f43-443b-8637-e97a3d2ea64a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:42.973641 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e82e4-3f43-443b-8637-e97a3d2ea64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-4e6e82e4-3f43-443b-8637-e97a3d2ea64a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:42.979310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:42.980389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:42.981356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:42.981356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:42.981356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:42.981356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:42.981356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:42.981356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:42.981356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:42.981356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:42.981356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:42.981356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:42.981356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:42.981356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:42.983977 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 174/341] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:58:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:42.996119 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e82e4-3f43-443b-8637-e97a3d2ea64a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:43.015808 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6991f59-1185-4532-8a53-3ca3205f22f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:43.017290 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6991f59-1185-4532-8a53-3ca3205f22f9 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:43.111534 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e82e4-3f43-443b-8637-e97a3d2ea64a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:43.155902 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860a5b5-8329-4382-8da0-f2b06a47aff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:43.156796 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860a5b5-8329-4382-8da0-f2b06a47aff0 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:43.157265 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860a5b5-8329-4382-8da0-f2b06a47aff0 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:43.157673 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860a5b5-8329-4382-8da0-f2b06a47aff0 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:43.158530 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860a5b5-8329-4382-8da0-f2b06a47aff0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:43.158994 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860a5b5-8329-4382-8da0-f2b06a47aff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:43.160914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860a5b5-8329-4382-8da0-f2b06a47aff0 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:43.175256 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 175/342] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:58:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:43.181986 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860a5b5-8329-4382-8da0-f2b06a47aff0 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:43.251371 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:43.303694 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860a5b5-8329-4382-8da0-f2b06a47aff0 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:43.312423 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 168/343] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:43.318224 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6991f59-1185-4532-8a53-3ca3205f22f9 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:43.343393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6e8e1-7547-4a3c-85ab-c845152600df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:43.344674 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6e8e1-7547-4a3c-85ab-c845152600df None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:43.345235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6e8e1-7547-4a3c-85ab-c845152600df None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:43.345675 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6e8e1-7547-4a3c-85ab-c845152600df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:43.383980 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:43.423844 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6e8e1-7547-4a3c-85ab-c845152600df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:43.425518 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6e8e1-7547-4a3c-85ab-c845152600df None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:43.522100 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6991f59-1185-4532-8a53-3ca3205f22f9 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:43.531605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:43.592563 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 176/344] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 23:58:43.594201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84457360-3b5b-421d-b8b9-e2cd06771875 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:43.594639 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84457360-3b5b-421d-b8b9-e2cd06771875 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:43.595082 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84457360-3b5b-421d-b8b9-e2cd06771875 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:43.596547 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 177/345] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:43.597793 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84457360-3b5b-421d-b8b9-e2cd06771875 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:43.603412 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7c3bd-7cb6-4068-b341-a548dc52acb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:43.604329 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7c3bd-7cb6-4068-b341-a548dc52acb5 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:43.604756 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7c3bd-7cb6-4068-b341-a548dc52acb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:43.605176 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7c3bd-7cb6-4068-b341-a548dc52acb5 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:43.606540 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7c3bd-7cb6-4068-b341-a548dc52acb5 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:43.608892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7c3bd-7cb6-4068-b341-a548dc52acb5 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:43.611022 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 169/346] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:43 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:43.612329 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55d76-3bc5-4a26-a2c3-aac4dff95dd7 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:43.612758 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55d76-3bc5-4a26-a2c3-aac4dff95dd7 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:43.613176 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55d76-3bc5-4a26-a2c3-aac4dff95dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:43.662739 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-67b55d76-3bc5-4a26-a2c3-aac4dff95dd7 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:43.664874 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-67b55d76-3bc5-4a26-a2c3-aac4dff95dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:43.737812 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84457360-3b5b-421d-b8b9-e2cd06771875 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:43.756064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 170/347] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:43.757317 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55d76-3bc5-4a26-a2c3-aac4dff95dd7 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:43.780529 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69366441-5ec4-4ff6-ba25-f7bfbd80e7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:43.781490 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69366441-5ec4-4ff6-ba25-f7bfbd80e7ce None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:43.781949 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69366441-5ec4-4ff6-ba25-f7bfbd80e7ce None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:43.782415 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69366441-5ec4-4ff6-ba25-f7bfbd80e7ce None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:43.783811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69366441-5ec4-4ff6-ba25-f7bfbd80e7ce None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:43.785429 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69366441-5ec4-4ff6-ba25-f7bfbd80e7ce None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:43.791657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 178/348] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:43 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:43.793119 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3dce-fa68-49a9-9128-26b6e44b9e9f None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:43.793594 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3dce-fa68-49a9-9128-26b6e44b9e9f None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:43.794044 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3dce-fa68-49a9-9128-26b6e44b9e9f None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:43.796395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 179/349] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:43.799428 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:43.807628 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949a51-6065-45de-8880-8dcd96ded35f None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:43.808229 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949a51-6065-45de-8880-8dcd96ded35f None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:43.808735 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949a51-6065-45de-8880-8dcd96ded35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:43.838887 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-f2949a51-6065-45de-8880-8dcd96ded35f None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:43.840372 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-f2949a51-6065-45de-8880-8dcd96ded35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:43.856623 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:43.889831 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55d76-3bc5-4a26-a2c3-aac4dff95dd7 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:43.911822 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 180/350] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:43.915988 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2949a51-6065-45de-8880-8dcd96ded35f None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:43.929174 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dc5d1-e5e6-4cfb-a1fe-5d18cff20969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:43.930334 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dc5d1-e5e6-4cfb-a1fe-5d18cff20969 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:43.930802 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dc5d1-e5e6-4cfb-a1fe-5d18cff20969 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:43.931237 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dc5d1-e5e6-4cfb-a1fe-5d18cff20969 None admin] PATH_INFO: `/v3/groups/3c29b3720ef84e349a5d872eb0a23905` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:43.938499 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dc5d1-e5e6-4cfb-a1fe-5d18cff20969 None admin] RBAC: Authorizing `identity:get_group(group_id=3c29b3720ef84e349a5d872eb0a23905)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:43.940471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dc5d1-e5e6-4cfb-a1fe-5d18cff20969 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:43.945696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 171/351] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:43 2022] GET /identity/v3/groups/3c29b3720ef84e349a5d872eb0a23905 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:43.946658 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dc5d1-e5e6-4cfb-a1fe-5d18cff20969 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:44.059881 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:44.066684 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2949a51-6065-45de-8880-8dcd96ded35f None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:44.069661 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dc5d1-e5e6-4cfb-a1fe-5d18cff20969 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:44.112799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a08489-3dd6-448e-a83f-974dcc5ce5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:44.113446 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a08489-3dd6-448e-a83f-974dcc5ce5d8 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:44.113728 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a08489-3dd6-448e-a83f-974dcc5ce5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:44.113998 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a08489-3dd6-448e-a83f-974dcc5ce5d8 None admin] PATH_INFO: `/v3/groups/3c29b3720ef84e349a5d872eb0a23905` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:44.116018 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a08489-3dd6-448e-a83f-974dcc5ce5d8 None admin] RBAC: Authorizing `identity:get_group(group_id=3c29b3720ef84e349a5d872eb0a23905)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:44.117467 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a08489-3dd6-448e-a83f-974dcc5ce5d8 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:44.119670 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 181/352] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:43 2022] GET /identity/v3/groups/3c29b3720ef84e349a5d872eb0a23905 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:44.123834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a08489-3dd6-448e-a83f-974dcc5ce5d8 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:44.125545 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0238ea6-c7cd-4d14-813a-cce764f5be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:44.126294 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0238ea6-c7cd-4d14-813a-cce764f5be24 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:44.126579 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0238ea6-c7cd-4d14-813a-cce764f5be24 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:44.126961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0238ea6-c7cd-4d14-813a-cce764f5be24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:44.142464 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0238ea6-c7cd-4d14-813a-cce764f5be24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-e0238ea6-c7cd-4d14-813a-cce764f5be24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:44.149429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:44.150377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:44.151288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 172/353] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:44.152006 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af383118-550d-40e3-9314-37750b711a1b None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:44.152140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af383118-550d-40e3-9314-37750b711a1b None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:44.152573 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af383118-550d-40e3-9314-37750b711a1b None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:44.154929 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 173/354] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:44.155289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:44.156355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af383118-550d-40e3-9314-37750b711a1b None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:44.266163 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a08489-3dd6-448e-a83f-974dcc5ce5d8 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:44.293780 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af383118-550d-40e3-9314-37750b711a1b None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:44.319394 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b41d8-b4e2-4604-a7d7-dbd8a63f0ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:44.320019 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b41d8-b4e2-4604-a7d7-dbd8a63f0ee4 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:44.320301 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b41d8-b4e2-4604-a7d7-dbd8a63f0ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:44.320572 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b41d8-b4e2-4604-a7d7-dbd8a63f0ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:44.321384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b41d8-b4e2-4604-a7d7-dbd8a63f0ee4 None admin] RBAC: Adding query filter params (group.id=3c29b3720ef84e349a5d872eb0a23905, role.id=5717836a50094587b879206794e7156a, scope.project.id=c21bfcd3302f46909780c42e4b2d702d) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:44.321693 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b41d8-b4e2-4604-a7d7-dbd8a63f0ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:44.323243 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b41d8-b4e2-4604-a7d7-dbd8a63f0ee4 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:44.330161 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 182/355] 10.222.0.65 () {56 vars in 1376 bytes} [Mon Jul 25 23:58:44 2022] GET /identity/v3/role_assignments?group.id=3c29b3720ef84e349a5d872eb0a23905&scope.project.id=c21bfcd3302f46909780c42e4b2d702d&role.id=5717836a50094587b879206794e7156a => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:44.331359 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b41d8-b4e2-4604-a7d7-dbd8a63f0ee4 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:44.352277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c45fd8-f163-4525-ba7c-cc1e74918579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:44.353233 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c45fd8-f163-4525-ba7c-cc1e74918579 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:44.353700 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c45fd8-f163-4525-ba7c-cc1e74918579 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:44.354165 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c45fd8-f163-4525-ba7c-cc1e74918579 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:44.368640 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c45fd8-f163-4525-ba7c-cc1e74918579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-f7c45fd8-f163-4525-ba7c-cc1e74918579 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:44.375940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:44.376922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:44.377695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:44.377695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:44.377695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:44.377695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:44.377695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:44.377695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:44.377695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:44.377695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:44.377695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:44.377695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:44.377695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:44.377695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:44.384174 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 174/356] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:44.385497 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c45fd8-f163-4525-ba7c-cc1e74918579 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:44.405884 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:44.454835 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:44.480973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b41d8-b4e2-4604-a7d7-dbd8a63f0ee4 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:44.524613 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c45fd8-f163-4525-ba7c-cc1e74918579 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:44.530401 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b47c5a-acad-489d-b2db-b1669e62a32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:44.531144 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b47c5a-acad-489d-b2db-b1669e62a32b None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:44.531500 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b47c5a-acad-489d-b2db-b1669e62a32b None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:44.531872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b47c5a-acad-489d-b2db-b1669e62a32b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:44.532727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b47c5a-acad-489d-b2db-b1669e62a32b None admin] RBAC: Adding query filter params (group.id=3c29b3720ef84e349a5d872eb0a23905, role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa, scope.project.id=c21bfcd3302f46909780c42e4b2d702d) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:44.533106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b47c5a-acad-489d-b2db-b1669e62a32b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:44.534685 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b47c5a-acad-489d-b2db-b1669e62a32b None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:44.545519 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 183/357] 10.222.0.65 () {56 vars in 1376 bytes} [Mon Jul 25 23:58:44 2022] GET /identity/v3/role_assignments?group.id=3c29b3720ef84e349a5d872eb0a23905&scope.project.id=c21bfcd3302f46909780c42e4b2d702d&role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:44.547201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f856b-b131-4547-9b11-1198c90e3306 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:44.547551 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f856b-b131-4547-9b11-1198c90e3306 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:44.547896 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f856b-b131-4547-9b11-1198c90e3306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:44.571639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c462645-e141-4e35-8027-7f6f374cc06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:44.572724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c462645-e141-4e35-8027-7f6f374cc06d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:44.574209 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c462645-e141-4e35-8027-7f6f374cc06d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:44.574825 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c462645-e141-4e35-8027-7f6f374cc06d None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:44.575890 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c462645-e141-4e35-8027-7f6f374cc06d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:44.576745 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c462645-e141-4e35-8027-7f6f374cc06d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:44.578559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c462645-e141-4e35-8027-7f6f374cc06d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:44.582699 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-f98f856b-b131-4547-9b11-1198c90e3306 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:44.584094 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-f98f856b-b131-4547-9b11-1198c90e3306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:44.589714 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 175/358] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:44.592614 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c462645-e141-4e35-8027-7f6f374cc06d None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:44.697032 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 184/359] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:44.698341 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f856b-b131-4547-9b11-1198c90e3306 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:44.702906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:44.739369 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c462645-e141-4e35-8027-7f6f374cc06d None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:44.793784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b02cb-24b2-4d5e-8ca2-f2d0f15d6b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:44.795204 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b02cb-24b2-4d5e-8ca2-f2d0f15d6b0f None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:44.795761 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b02cb-24b2-4d5e-8ca2-f2d0f15d6b0f None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:44.796259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b02cb-24b2-4d5e-8ca2-f2d0f15d6b0f None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:44.797112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b02cb-24b2-4d5e-8ca2-f2d0f15d6b0f None admin] RBAC: Adding query filter params (name=member) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:44.798159 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b02cb-24b2-4d5e-8ca2-f2d0f15d6b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:44.799736 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b02cb-24b2-4d5e-8ca2-f2d0f15d6b0f None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:44.807137 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:44.813845 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 176/360] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:44.815263 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8323e-2c65-452c-95c0-7335f108b641 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:44.815556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8323e-2c65-452c-95c0-7335f108b641 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:44.815905 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8323e-2c65-452c-95c0-7335f108b641 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:44.818941 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 177/361] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:44.819818 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8323e-2c65-452c-95c0-7335f108b641 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:44.836454 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f856b-b131-4547-9b11-1198c90e3306 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:44.875140 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5177d-3e70-477f-b299-63c48ffd5eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:44.875887 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5177d-3e70-477f-b299-63c48ffd5eda None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:44.876174 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5177d-3e70-477f-b299-63c48ffd5eda None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:44.876452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5177d-3e70-477f-b299-63c48ffd5eda None admin] PATH_INFO: `/v3/users/98cb010ad5de492d9dbe9e3a470a759b` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:44.877640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5177d-3e70-477f-b299-63c48ffd5eda None admin] RBAC: Authorizing `identity:get_user(user_id=98cb010ad5de492d9dbe9e3a470a759b)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:44.879465 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5177d-3e70-477f-b299-63c48ffd5eda None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:44.881406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 185/362] 10.222.0.65 () {56 vars in 1177 bytes} [Mon Jul 25 23:58:44 2022] GET /identity/v3/users/98cb010ad5de492d9dbe9e3a470a759b => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:44.882412 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5177d-3e70-477f-b299-63c48ffd5eda None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:44.935969 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8323e-2c65-452c-95c0-7335f108b641 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:44.988996 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aa06b-46f1-41dd-8135-16df772b6c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:44.989980 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aa06b-46f1-41dd-8135-16df772b6c61 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:44.990488 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aa06b-46f1-41dd-8135-16df772b6c61 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:44.991018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aa06b-46f1-41dd-8135-16df772b6c61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:45.000168 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:45.004925 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4aa06b-46f1-41dd-8135-16df772b6c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-0e4aa06b-46f1-41dd-8135-16df772b6c61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:45.012368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:45.013337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:45.014220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:45.014220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:45.014220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:45.014220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:45.014220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:45.014220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:45.014220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:45.014220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:45.014220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:45.014220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:45.014220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:45.014220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:45.014871 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 178/363] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:58:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:45.016661 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788b010-bb07-48a9-b9a9-a11859045438 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:45.017474 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788b010-bb07-48a9-b9a9-a11859045438 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:45.018023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788b010-bb07-48a9-b9a9-a11859045438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:45.019986 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5177d-3e70-477f-b299-63c48ffd5eda None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:45.043331 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-9788b010-bb07-48a9-b9a9-a11859045438 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:45.044675 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-9788b010-bb07-48a9-b9a9-a11859045438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:45.069542 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445507d-45a8-4a61-a656-2b8b55a5de2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:45.070177 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445507d-45a8-4a61-a656-2b8b55a5de2e None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:45.070459 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445507d-45a8-4a61-a656-2b8b55a5de2e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:45.070777 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445507d-45a8-4a61-a656-2b8b55a5de2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:45.094634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:45.147869 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 179/364] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:45.149428 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788b010-bb07-48a9-b9a9-a11859045438 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:45.171694 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445507d-45a8-4a61-a656-2b8b55a5de2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:45.173294 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445507d-45a8-4a61-a656-2b8b55a5de2e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:45.278062 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788b010-bb07-48a9-b9a9-a11859045438 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:45.312842 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 186/365] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:45.314379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445507d-45a8-4a61-a656-2b8b55a5de2e None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:45.317037 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:45.321149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d236ad1-c626-4f4a-a05f-9d0dd4c635f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:45.321874 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d236ad1-c626-4f4a-a05f-9d0dd4c635f3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:45.322232 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d236ad1-c626-4f4a-a05f-9d0dd4c635f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:45.322583 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d236ad1-c626-4f4a-a05f-9d0dd4c635f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:45.323531 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d236ad1-c626-4f4a-a05f-9d0dd4c635f3 None admin] RBAC: Adding query filter params (role.id=d468e85ca7384bef9a2e312a37b543fa, user.id=98cb010ad5de492d9dbe9e3a470a759b, scope.system=all) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:45.324105 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d236ad1-c626-4f4a-a05f-9d0dd4c635f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:45.326987 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d236ad1-c626-4f4a-a05f-9d0dd4c635f3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:45.342162 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 180/366] 10.222.0.65 () {56 vars in 1308 bytes} [Mon Jul 25 23:58:45 2022] GET /identity/v3/role_assignments?user.id=98cb010ad5de492d9dbe9e3a470a759b&scope.system=all&role.id=d468e85ca7384bef9a2e312a37b543fa => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:45.343182 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d236ad1-c626-4f4a-a05f-9d0dd4c635f3 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:45.377014 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:45.448778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445507d-45a8-4a61-a656-2b8b55a5de2e None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:45.493262 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556822-ddc3-4bf5-9db0-c10ee3ea67bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:45.494242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556822-ddc3-4bf5-9db0-c10ee3ea67bb None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:45.494750 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556822-ddc3-4bf5-9db0-c10ee3ea67bb None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:45.495202 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556822-ddc3-4bf5-9db0-c10ee3ea67bb None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:45.497248 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c556822-ddc3-4bf5-9db0-c10ee3ea67bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:45.497851 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c556822-ddc3-4bf5-9db0-c10ee3ea67bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:45.499485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c556822-ddc3-4bf5-9db0-c10ee3ea67bb None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:45.510997 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 187/367] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:58:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:45.512147 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556822-ddc3-4bf5-9db0-c10ee3ea67bb None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:45.566355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d236ad1-c626-4f4a-a05f-9d0dd4c635f3 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:45.627057 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f131885-89ea-48a6-b9eb-da5796d64007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:45.627841 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f131885-89ea-48a6-b9eb-da5796d64007 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:45.628123 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f131885-89ea-48a6-b9eb-da5796d64007 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:45.628398 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f131885-89ea-48a6-b9eb-da5796d64007 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:45.633715 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556822-ddc3-4bf5-9db0-c10ee3ea67bb None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:45.644582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f131885-89ea-48a6-b9eb-da5796d64007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-0f131885-89ea-48a6-b9eb-da5796d64007 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:45.652073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:45.652956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:45.653752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:45.653752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:45.653752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:45.653752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:45.653752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:45.653752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:45.653752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:45.653752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:45.653752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:45.653752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:45.653752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:45.653752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:45.654438 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 181/368] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:58:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:45.655355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f131885-89ea-48a6-b9eb-da5796d64007 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:45.657946 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:45.682602 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b774a2f-812f-4d06-a2c4-f5cf57958e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:45.683563 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b774a2f-812f-4d06-a2c4-f5cf57958e55 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:45.684051 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b774a2f-812f-4d06-a2c4-f5cf57958e55 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:45.684503 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b774a2f-812f-4d06-a2c4-f5cf57958e55 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:45.686993 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b774a2f-812f-4d06-a2c4-f5cf57958e55 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:45.688684 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b774a2f-812f-4d06-a2c4-f5cf57958e55 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:45.691584 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 188/369] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:45 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:45.692579 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b774a2f-812f-4d06-a2c4-f5cf57958e55 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:45.722071 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:45.791254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f131885-89ea-48a6-b9eb-da5796d64007 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:45.817028 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b774a2f-812f-4d06-a2c4-f5cf57958e55 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:45.831434 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174fe10-1968-492d-b167-809758399b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:45.832056 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174fe10-1968-492d-b167-809758399b2c None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:45.832336 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174fe10-1968-492d-b167-809758399b2c None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:45.832774 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174fe10-1968-492d-b167-809758399b2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:45.856734 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d7cea-1067-4dc1-839c-9c5c6ec269c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:45.858408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7cea-1067-4dc1-839c-9c5c6ec269c5 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:45.859084 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7cea-1067-4dc1-839c-9c5c6ec269c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:45.859558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7cea-1067-4dc1-839c-9c5c6ec269c5 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:45.860623 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d7cea-1067-4dc1-839c-9c5c6ec269c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:45.861145 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d7cea-1067-4dc1-839c-9c5c6ec269c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:45.862902 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d7cea-1067-4dc1-839c-9c5c6ec269c5 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:45.872259 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 189/370] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:45.873501 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d7cea-1067-4dc1-839c-9c5c6ec269c5 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:45.911227 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:45.913686 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174fe10-1968-492d-b167-809758399b2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:45.915442 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174fe10-1968-492d-b167-809758399b2c None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:45.968289 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:45.987421 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d7cea-1067-4dc1-839c-9c5c6ec269c5 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:46.033699 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27f5d7-b070-4d5f-b6f6-820a63dfe1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:46.034699 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27f5d7-b070-4d5f-b6f6-820a63dfe1bb None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:46.035211 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27f5d7-b070-4d5f-b6f6-820a63dfe1bb None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:46.035675 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27f5d7-b070-4d5f-b6f6-820a63dfe1bb None admin] PATH_INFO: `/v3/groups/3c29b3720ef84e349a5d872eb0a23905` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:46.036056 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 182/371] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:46.037013 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174fe10-1968-492d-b167-809758399b2c None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:46.037507 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27f5d7-b070-4d5f-b6f6-820a63dfe1bb None admin] RBAC: Authorizing `identity:get_group(group_id=3c29b3720ef84e349a5d872eb0a23905)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:46.039185 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27f5d7-b070-4d5f-b6f6-820a63dfe1bb None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:46.041292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 190/372] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:45 2022] GET /identity/v3/groups/3c29b3720ef84e349a5d872eb0a23905 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:46.042292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27f5d7-b070-4d5f-b6f6-820a63dfe1bb None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:46.154984 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174fe10-1968-492d-b167-809758399b2c None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:46.162014 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27f5d7-b070-4d5f-b6f6-820a63dfe1bb None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:46.165212 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:46.200713 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f5e03-efa2-4c50-ba39-909507a192f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:46.202307 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f5e03-efa2-4c50-ba39-909507a192f4 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:46.202734 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f5e03-efa2-4c50-ba39-909507a192f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:46.202857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b8675-236d-4fe7-b614-74d13c7feb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:46.203235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f5e03-efa2-4c50-ba39-909507a192f4 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:46.203773 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b8675-236d-4fe7-b614-74d13c7feb6b None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:46.204186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b8675-236d-4fe7-b614-74d13c7feb6b None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:46.204600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b8675-236d-4fe7-b614-74d13c7feb6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:46.204792 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f5e03-efa2-4c50-ba39-909507a192f4 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:46.206434 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f5e03-efa2-4c50-ba39-909507a192f4 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:46.208648 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 191/373] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:46 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:46.209700 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f5e03-efa2-4c50-ba39-909507a192f4 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:46.235107 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:46.282565 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b8675-236d-4fe7-b614-74d13c7feb6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:46.284264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b8675-236d-4fe7-b614-74d13c7feb6b None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:46.320393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f5e03-efa2-4c50-ba39-909507a192f4 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:46.355566 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4f33a-8d90-43dd-8539-de242d2aee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:46.356347 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4f33a-8d90-43dd-8539-de242d2aee31 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:46.356761 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4f33a-8d90-43dd-8539-de242d2aee31 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:46.358942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4f33a-8d90-43dd-8539-de242d2aee31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:46.359820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4f33a-8d90-43dd-8539-de242d2aee31 None admin] RBAC: Adding query filter params (group.id=3c29b3720ef84e349a5d872eb0a23905, role.id=5717836a50094587b879206794e7156a, scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:46.360236 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4f33a-8d90-43dd-8539-de242d2aee31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:46.361842 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4f33a-8d90-43dd-8539-de242d2aee31 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:46.367867 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 192/374] 10.222.0.65 () {56 vars in 1376 bytes} [Mon Jul 25 23:58:46 2022] GET /identity/v3/role_assignments?group.id=3c29b3720ef84e349a5d872eb0a23905&scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d&role.id=5717836a50094587b879206794e7156a => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:46.368768 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4f33a-8d90-43dd-8539-de242d2aee31 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:46.409023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 183/375] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:46.409883 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:46.411479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b8675-236d-4fe7-b614-74d13c7feb6b None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:46.470756 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:46.487369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4f33a-8d90-43dd-8539-de242d2aee31 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:46.525404 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba867dc-8fc6-4088-9752-b4b4456a5856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:46.526215 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba867dc-8fc6-4088-9752-b4b4456a5856 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:46.526571 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba867dc-8fc6-4088-9752-b4b4456a5856 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:46.526962 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba867dc-8fc6-4088-9752-b4b4456a5856 None admin] PATH_INFO: `/v3/groups/3c29b3720ef84e349a5d872eb0a23905` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:46.528282 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba867dc-8fc6-4088-9752-b4b4456a5856 None admin] RBAC: Authorizing `identity:get_group(group_id=3c29b3720ef84e349a5d872eb0a23905)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:46.530581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba867dc-8fc6-4088-9752-b4b4456a5856 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:46.532287 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 193/376] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:46 2022] GET /identity/v3/groups/3c29b3720ef84e349a5d872eb0a23905 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:46.539996 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba867dc-8fc6-4088-9752-b4b4456a5856 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:46.547657 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b8675-236d-4fe7-b614-74d13c7feb6b None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:46.632169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687a11d-8bf1-498e-9d16-d6bbe61bf804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:46.633189 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687a11d-8bf1-498e-9d16-d6bbe61bf804 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:46.633686 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687a11d-8bf1-498e-9d16-d6bbe61bf804 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:46.634152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687a11d-8bf1-498e-9d16-d6bbe61bf804 None admin] PATH_INFO: `/v3/projects/a89d9c4e1862458dba91de9a0e7a6b24` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:46.637452 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687a11d-8bf1-498e-9d16-d6bbe61bf804 None admin] RBAC: Authorizing `identity:get_project(project_id=a89d9c4e1862458dba91de9a0e7a6b24)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:46.639618 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687a11d-8bf1-498e-9d16-d6bbe61bf804 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:46.643050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 184/377] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:46 2022] GET /identity/v3/projects/a89d9c4e1862458dba91de9a0e7a6b24 => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:46.648346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687a11d-8bf1-498e-9d16-d6bbe61bf804 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:46.668078 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba867dc-8fc6-4088-9752-b4b4456a5856 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:46.671022 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:46.715976 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175ae08-cae8-4ebc-8692-950b61566674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:46.717301 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175ae08-cae8-4ebc-8692-950b61566674 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:46.717581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175ae08-cae8-4ebc-8692-950b61566674 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:46.717856 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175ae08-cae8-4ebc-8692-950b61566674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:46.718658 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175ae08-cae8-4ebc-8692-950b61566674 None admin] RBAC: Adding query filter params (group.id=3c29b3720ef84e349a5d872eb0a23905, role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa, scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:46.719017 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175ae08-cae8-4ebc-8692-950b61566674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:46.721113 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175ae08-cae8-4ebc-8692-950b61566674 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:46.730560 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 194/378] 10.222.0.65 () {56 vars in 1376 bytes} [Mon Jul 25 23:58:46 2022] GET /identity/v3/role_assignments?group.id=3c29b3720ef84e349a5d872eb0a23905&scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d&role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:46.790698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687a11d-8bf1-498e-9d16-d6bbe61bf804 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:46.807971 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:46.836617 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653b29b-67ec-40c2-8165-7de772449efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:46.837279 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653b29b-67ec-40c2-8165-7de772449efb None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:46.837560 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653b29b-67ec-40c2-8165-7de772449efb None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:46.837836 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653b29b-67ec-40c2-8165-7de772449efb None admin] PATH_INFO: `/v3/groups/535cff6c5b3445a28f1bd72938b548e0` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:46.848045 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653b29b-67ec-40c2-8165-7de772449efb None admin] RBAC: Authorizing `identity:get_group(group_id=535cff6c5b3445a28f1bd72938b548e0)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:46.849522 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653b29b-67ec-40c2-8165-7de772449efb None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:46.851823 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 185/379] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:46 2022] GET /identity/v3/groups/535cff6c5b3445a28f1bd72938b548e0 => generated 229 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:46.858220 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175ae08-cae8-4ebc-8692-950b61566674 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:46.975199 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175ae08-cae8-4ebc-8692-950b61566674 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:47.021858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c54959-9054-43cd-aee0-4325e472c930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:47.022496 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c54959-9054-43cd-aee0-4325e472c930 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:47.022834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c54959-9054-43cd-aee0-4325e472c930 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:47.023117 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c54959-9054-43cd-aee0-4325e472c930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:47.023910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c54959-9054-43cd-aee0-4325e472c930 None admin] RBAC: Adding query filter params (group.id=535cff6c5b3445a28f1bd72938b548e0, role.id=5d947b934e0642c5a4ab00d547ec3fda, scope.project.id=a89d9c4e1862458dba91de9a0e7a6b24) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:47.024224 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c54959-9054-43cd-aee0-4325e472c930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:47.025669 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c54959-9054-43cd-aee0-4325e472c930 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:47.033041 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 195/380] 10.222.0.65 () {56 vars in 1376 bytes} [Mon Jul 25 23:58:46 2022] GET /identity/v3/role_assignments?group.id=535cff6c5b3445a28f1bd72938b548e0&scope.project.id=a89d9c4e1862458dba91de9a0e7a6b24&role.id=5d947b934e0642c5a4ab00d547ec3fda => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:47.448452 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aff0f9-7ab0-4ce9-9afb-8aa4a33201a0 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:47.448959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aff0f9-7ab0-4ce9-9afb-8aa4a33201a0 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:47.449039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aff0f9-7ab0-4ce9-9afb-8aa4a33201a0 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:47.450342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 186/381] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:47.457247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6710e4-c294-4073-b318-2cce44206456 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:47.457715 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6710e4-c294-4073-b318-2cce44206456 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:47.458005 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6710e4-c294-4073-b318-2cce44206456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:47.460684 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef9417-e513-48d9-9cd9-bbb81d3e2c92 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:47.460976 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef9417-e513-48d9-9cd9-bbb81d3e2c92 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:47.461254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef9417-e513-48d9-9cd9-bbb81d3e2c92 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:47.462878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 187/382] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:47.468110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178dc8a-71f7-4229-bd4c-71294a474279 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:47.468644 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178dc8a-71f7-4229-bd4c-71294a474279 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:47.469128 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178dc8a-71f7-4229-bd4c-71294a474279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:47.486127 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-6c6710e4-c294-4073-b318-2cce44206456 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:47.487348 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-6c6710e4-c294-4073-b318-2cce44206456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:47.492532 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-9178dc8a-71f7-4229-bd4c-71294a474279 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:47.493972 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-9178dc8a-71f7-4229-bd4c-71294a474279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:47.530980 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:47.588523 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 196/383] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:47.617642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6710e4-c294-4073-b318-2cce44206456 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:47.647928 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 188/384] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:47.699934 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178dc8a-71f7-4229-bd4c-71294a474279 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:47.748007 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6710e4-c294-4073-b318-2cce44206456 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:47.793151 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420cf3c-7fe4-4ec3-8eef-51a9574f1ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:47.793801 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420cf3c-7fe4-4ec3-8eef-51a9574f1ed1 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:47.794085 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420cf3c-7fe4-4ec3-8eef-51a9574f1ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:47.795108 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420cf3c-7fe4-4ec3-8eef-51a9574f1ed1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:47.812739 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420cf3c-7fe4-4ec3-8eef-51a9574f1ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-3420cf3c-7fe4-4ec3-8eef-51a9574f1ed1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:47.818225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:47.819128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:47.819912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:47.819912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:47.819912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:47.819912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:47.819912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:47.819912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:47.819912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:47.819912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:47.819912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:47.819912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:47.819912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:47.819912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:47.821005 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 197/385] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:47.826416 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420cf3c-7fe4-4ec3-8eef-51a9574f1ed1 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:47.855659 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:47.954793 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178dc8a-71f7-4229-bd4c-71294a474279 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:47.959458 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420cf3c-7fe4-4ec3-8eef-51a9574f1ed1 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:47.974182 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:48.021385 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb899aa-a85a-487d-8dce-a51e15fb1d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:48.022046 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb899aa-a85a-487d-8dce-a51e15fb1d77 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:48.022327 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb899aa-a85a-487d-8dce-a51e15fb1d77 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:48.022605 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb899aa-a85a-487d-8dce-a51e15fb1d77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:48.032707 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dda00-2a4d-45d1-8d46-eb9f2652256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:48.033388 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dda00-2a4d-45d1-8d46-eb9f2652256b None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:48.033673 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dda00-2a4d-45d1-8d46-eb9f2652256b None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:48.033948 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dda00-2a4d-45d1-8d46-eb9f2652256b None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:48.034666 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dda00-2a4d-45d1-8d46-eb9f2652256b None admin] RBAC: Adding query filter params (name=member) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:48.034993 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dda00-2a4d-45d1-8d46-eb9f2652256b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:48.036379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dda00-2a4d-45d1-8d46-eb9f2652256b None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:48.048961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb899aa-a85a-487d-8dce-a51e15fb1d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:48.053543 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 198/386] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-bfb899aa-a85a-487d-8dce-a51e15fb1d77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:48.056285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:48.057149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:48.057975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 189/387] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:58:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:48.060254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dda00-2a4d-45d1-8d46-eb9f2652256b None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:48.063812 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb899aa-a85a-487d-8dce-a51e15fb1d77 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:48.223165 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:48.245260 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dda00-2a4d-45d1-8d46-eb9f2652256b None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:48.275923 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb899aa-a85a-487d-8dce-a51e15fb1d77 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:48.325373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9b7c8-dbb6-4a36-9c27-bffd5b66cd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:48.326817 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9b7c8-dbb6-4a36-9c27-bffd5b66cd88 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:48.327101 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9b7c8-dbb6-4a36-9c27-bffd5b66cd88 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:48.327375 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9b7c8-dbb6-4a36-9c27-bffd5b66cd88 None admin] PATH_INFO: `/v3/groups/3c29b3720ef84e349a5d872eb0a23905` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:48.328537 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9b7c8-dbb6-4a36-9c27-bffd5b66cd88 None admin] RBAC: Authorizing `identity:get_group(group_id=3c29b3720ef84e349a5d872eb0a23905)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:48.329978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9b7c8-dbb6-4a36-9c27-bffd5b66cd88 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:48.333341 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 199/388] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:48 2022] GET /identity/v3/groups/3c29b3720ef84e349a5d872eb0a23905 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:48.338473 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9b7c8-dbb6-4a36-9c27-bffd5b66cd88 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:48.350322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88932475-abb4-4be4-970d-c860a9c0d4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:48.351039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88932475-abb4-4be4-970d-c860a9c0d4d2 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:48.351319 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88932475-abb4-4be4-970d-c860a9c0d4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:48.351590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88932475-abb4-4be4-970d-c860a9c0d4d2 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:48.352305 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88932475-abb4-4be4-970d-c860a9c0d4d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:48.352604 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88932475-abb4-4be4-970d-c860a9c0d4d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:48.353986 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88932475-abb4-4be4-970d-c860a9c0d4d2 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:48.375305 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 190/389] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:58:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:48.376555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88932475-abb4-4be4-970d-c860a9c0d4d2 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:48.425254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:48.520603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88932475-abb4-4be4-970d-c860a9c0d4d2 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:48.561048 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9b7c8-dbb6-4a36-9c27-bffd5b66cd88 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:48.604393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34225ed8-bcc6-42f8-9446-335b5efe0e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:48.605483 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34225ed8-bcc6-42f8-9446-335b5efe0e39 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:48.605911 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34225ed8-bcc6-42f8-9446-335b5efe0e39 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:48.606363 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34225ed8-bcc6-42f8-9446-335b5efe0e39 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:48.608364 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34225ed8-bcc6-42f8-9446-335b5efe0e39 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:48.609962 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34225ed8-bcc6-42f8-9446-335b5efe0e39 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:48.614391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 200/390] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:48 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:48.619809 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34225ed8-bcc6-42f8-9446-335b5efe0e39 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:48.620480 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34c111-aa70-444c-869b-8175a728103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:48.621246 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34c111-aa70-444c-869b-8175a728103c None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:48.621635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34c111-aa70-444c-869b-8175a728103c None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:48.622031 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34c111-aa70-444c-869b-8175a728103c None admin] PATH_INFO: `/v3/groups/3c29b3720ef84e349a5d872eb0a23905` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:48.627585 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34c111-aa70-444c-869b-8175a728103c None admin] RBAC: Authorizing `identity:get_group(group_id=3c29b3720ef84e349a5d872eb0a23905)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:48.629246 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34c111-aa70-444c-869b-8175a728103c None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:48.631443 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 191/391] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:48 2022] GET /identity/v3/groups/3c29b3720ef84e349a5d872eb0a23905 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:48.637180 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34c111-aa70-444c-869b-8175a728103c None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:48.647958 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:48.791736 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34225ed8-bcc6-42f8-9446-335b5efe0e39 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:48.826073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:48.834454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34c111-aa70-444c-869b-8175a728103c None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:48.860180 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57b26a-ae4a-4943-810c-26bb095a7b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:48.860872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57b26a-ae4a-4943-810c-26bb095a7b41 None admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:48.861157 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57b26a-ae4a-4943-810c-26bb095a7b41 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:48.861433 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57b26a-ae4a-4943-810c-26bb095a7b41 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d/groups/3c29b3720ef84e349a5d872eb0a23905/roles/5717836a50094587b879206794e7156a` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:48.864530 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57b26a-ae4a-4943-810c-26bb095a7b41 None admin] RBAC: Authorizing `identity:create_grant(project_id=c21bfcd3302f46909780c42e4b2d702d, group_id=3c29b3720ef84e349a5d872eb0a23905, role_id=5717836a50094587b879206794e7156a)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:48.867106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57b26a-ae4a-4943-810c-26bb095a7b41 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:48.893178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 201/392] 10.222.0.65 () {58 vars in 1442 bytes} [Mon Jul 25 23:58:48 2022] PUT /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d/groups/3c29b3720ef84e349a5d872eb0a23905/roles/5717836a50094587b879206794e7156a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:58:48.899309 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549b83b-8315-4cd0-9639-67878a9825ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:48.900272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549b83b-8315-4cd0-9639-67878a9825ad None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:48.900795 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549b83b-8315-4cd0-9639-67878a9825ad None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:48.901273 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549b83b-8315-4cd0-9639-67878a9825ad None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:48.902913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549b83b-8315-4cd0-9639-67878a9825ad None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:48.905421 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549b83b-8315-4cd0-9639-67878a9825ad None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:48.907768 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 192/393] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:48 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:48.913397 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57b26a-ae4a-4943-810c-26bb095a7b41 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:49.051356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:49.080476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57b26a-ae4a-4943-810c-26bb095a7b41 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:49.121823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367f392-fc15-459f-948a-0fe1eeb52632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:49.123069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367f392-fc15-459f-948a-0fe1eeb52632 None admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:49.123393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367f392-fc15-459f-948a-0fe1eeb52632 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:49.123631 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367f392-fc15-459f-948a-0fe1eeb52632 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d/groups/3c29b3720ef84e349a5d872eb0a23905/roles/c88cff91a5454c9ea5c03c9eb0a7a2aa` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:49.125848 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367f392-fc15-459f-948a-0fe1eeb52632 None admin] RBAC: Authorizing `identity:create_grant(project_id=c21bfcd3302f46909780c42e4b2d702d, group_id=3c29b3720ef84e349a5d872eb0a23905, role_id=c88cff91a5454c9ea5c03c9eb0a7a2aa)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:49.127330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367f392-fc15-459f-948a-0fe1eeb52632 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:49.144562 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 202/394] 10.222.0.65 () {58 vars in 1442 bytes} [Mon Jul 25 23:58:48 2022] PUT /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d/groups/3c29b3720ef84e349a5d872eb0a23905/roles/c88cff91a5454c9ea5c03c9eb0a7a2aa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:58:49.511217 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ae02-4402-41ab-ac23-fc9601087e47 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:49.511873 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ae02-4402-41ab-ac23-fc9601087e47 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:49.512392 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ae02-4402-41ab-ac23-fc9601087e47 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:49.515237 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 193/395] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:49.520349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2574929-9bd2-4c5e-ad1b-548743626b51 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:49.521294 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2574929-9bd2-4c5e-ad1b-548743626b51 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:49.521294 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2574929-9bd2-4c5e-ad1b-548743626b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:49.548488 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-b2574929-9bd2-4c5e-ad1b-548743626b51 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:49.549693 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-b2574929-9bd2-4c5e-ad1b-548743626b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:49.645734 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 203/396] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:49.683605 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0ae02-4402-41ab-ac23-fc9601087e47 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:49.834231 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0ae02-4402-41ab-ac23-fc9601087e47 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:49.868181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674ca8-8131-4c9d-8624-9fcee0f7f86b None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:49.868830 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674ca8-8131-4c9d-8624-9fcee0f7f86b None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:49.869310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674ca8-8131-4c9d-8624-9fcee0f7f86b None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:49.871156 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 204/397] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:49.877543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23018c55-083c-4c3a-a5b3-5686732e009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:49.877946 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b887e2-66b8-4d1e-a793-228f3a9fb3c1 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:49.878186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23018c55-083c-4c3a-a5b3-5686732e009a None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:49.878468 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23018c55-083c-4c3a-a5b3-5686732e009a None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:49.878762 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23018c55-083c-4c3a-a5b3-5686732e009a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:49.879095 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b887e2-66b8-4d1e-a793-228f3a9fb3c1 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:49.879622 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b887e2-66b8-4d1e-a793-228f3a9fb3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:49.893634 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23018c55-083c-4c3a-a5b3-5686732e009a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-23018c55-083c-4c3a-a5b3-5686732e009a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:49.899574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:49.900455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:49.901248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 194/398] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:49.910134 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23018c55-083c-4c3a-a5b3-5686732e009a None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:49.913471 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-35b887e2-66b8-4d1e-a793-228f3a9fb3c1 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:49.915187 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-35b887e2-66b8-4d1e-a793-228f3a9fb3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:49.969699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:50.037758 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:50.054861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 205/399] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:50.055500 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef27286-8d48-4fd2-8afb-7813229e21af None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:50.055787 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef27286-8d48-4fd2-8afb-7813229e21af None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:50.056067 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef27286-8d48-4fd2-8afb-7813229e21af None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:50.057861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 206/400] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:50.064360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62667f7c-60f2-4306-afa1-01ef38d2874b None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:50.064829 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62667f7c-60f2-4306-afa1-01ef38d2874b None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:50.065270 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62667f7c-60f2-4306-afa1-01ef38d2874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:50.093016 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23018c55-083c-4c3a-a5b3-5686732e009a None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:50.093809 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-62667f7c-60f2-4306-afa1-01ef38d2874b None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:50.095244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-62667f7c-60f2-4306-afa1-01ef38d2874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:50.138598 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1f512-5c64-4639-a763-e970d960abc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:50.139424 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1f512-5c64-4639-a763-e970d960abc9 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:50.139652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1f512-5c64-4639-a763-e970d960abc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:50.139928 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1f512-5c64-4639-a763-e970d960abc9 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:50.140653 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1f512-5c64-4639-a763-e970d960abc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:50.140963 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1f512-5c64-4639-a763-e970d960abc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:50.142367 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1f512-5c64-4639-a763-e970d960abc9 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:50.152209 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 195/401] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:50.153035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1f512-5c64-4639-a763-e970d960abc9 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:50.185749 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 207/402] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:50.186670 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62667f7c-60f2-4306-afa1-01ef38d2874b None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:50.249721 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:50.262161 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1f512-5c64-4639-a763-e970d960abc9 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:50.298530 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52e6b1-7475-4da0-ba31-01a3da68edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:50.299211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52e6b1-7475-4da0-ba31-01a3da68edaf None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:50.299582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52e6b1-7475-4da0-ba31-01a3da68edaf None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:50.299857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52e6b1-7475-4da0-ba31-01a3da68edaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:50.311460 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52e6b1-7475-4da0-ba31-01a3da68edaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:50.311776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62667f7c-60f2-4306-afa1-01ef38d2874b None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-8f52e6b1-7475-4da0-ba31-01a3da68edaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:50.323664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:50.324556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:50.325342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 196/403] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:58:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:50.331155 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52e6b1-7475-4da0-ba31-01a3da68edaf None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:50.344845 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:50.352856 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076ce51-45d0-4abb-88a2-fde37560bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:50.353513 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076ce51-45d0-4abb-88a2-fde37560bffa None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:50.353799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076ce51-45d0-4abb-88a2-fde37560bffa None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:50.354464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076ce51-45d0-4abb-88a2-fde37560bffa None admin] PATH_INFO: `/v3/groups/3c29b3720ef84e349a5d872eb0a23905` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:50.355666 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076ce51-45d0-4abb-88a2-fde37560bffa None admin] RBAC: Authorizing `identity:get_group(group_id=3c29b3720ef84e349a5d872eb0a23905)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:50.357793 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076ce51-45d0-4abb-88a2-fde37560bffa None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:50.359918 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 208/404] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:50 2022] GET /identity/v3/groups/3c29b3720ef84e349a5d872eb0a23905 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:50.361806 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076ce51-45d0-4abb-88a2-fde37560bffa None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:50.455119 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52e6b1-7475-4da0-ba31-01a3da68edaf None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:50.484738 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076ce51-45d0-4abb-88a2-fde37560bffa None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:50.501825 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a105d67-482c-4218-bf1e-3eecac44847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:50.502587 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a105d67-482c-4218-bf1e-3eecac44847b None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:50.502912 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a105d67-482c-4218-bf1e-3eecac44847b None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:50.503193 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a105d67-482c-4218-bf1e-3eecac44847b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:50.520596 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a105d67-482c-4218-bf1e-3eecac44847b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:50.526657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddba6c9-a156-4f8e-9c09-aa36231ca76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-8a105d67-482c-4218-bf1e-3eecac44847b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:50.527050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:50.528018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:50.529344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 197/405] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:58:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:50.529987 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a105d67-482c-4218-bf1e-3eecac44847b None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:50.531138 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddba6c9-a156-4f8e-9c09-aa36231ca76e None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:50.531629 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddba6c9-a156-4f8e-9c09-aa36231ca76e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:50.532112 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddba6c9-a156-4f8e-9c09-aa36231ca76e None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:50.534338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddba6c9-a156-4f8e-9c09-aa36231ca76e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:50.534904 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddba6c9-a156-4f8e-9c09-aa36231ca76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:50.536513 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddba6c9-a156-4f8e-9c09-aa36231ca76e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:50.541523 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:50.550879 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 209/406] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:58:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:50.551969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddba6c9-a156-4f8e-9c09-aa36231ca76e None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:50.620509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:50.659798 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a105d67-482c-4218-bf1e-3eecac44847b None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:50.667158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddba6c9-a156-4f8e-9c09-aa36231ca76e None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:50.697259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b512b3a-5cb6-41da-a82f-401aa019f7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:50.697893 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b512b3a-5cb6-41da-a82f-401aa019f7f4 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:50.698170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b512b3a-5cb6-41da-a82f-401aa019f7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:50.698548 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b512b3a-5cb6-41da-a82f-401aa019f7f4 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:50.699836 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b512b3a-5cb6-41da-a82f-401aa019f7f4 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:50.701945 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b512b3a-5cb6-41da-a82f-401aa019f7f4 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:50.704044 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 198/407] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:50 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:50.704872 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b512b3a-5cb6-41da-a82f-401aa019f7f4 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:50.705894 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b865194-1647-4d02-95b9-c410a4e030d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:50.706609 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b865194-1647-4d02-95b9-c410a4e030d3 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:50.706983 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b865194-1647-4d02-95b9-c410a4e030d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:50.707326 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b865194-1647-4d02-95b9-c410a4e030d3 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:50.708156 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b865194-1647-4d02-95b9-c410a4e030d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:50.708526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b865194-1647-4d02-95b9-c410a4e030d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:50.710045 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b865194-1647-4d02-95b9-c410a4e030d3 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:50.719607 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 210/408] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:50.724886 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b865194-1647-4d02-95b9-c410a4e030d3 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:50.791295 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:50.819714 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b512b3a-5cb6-41da-a82f-401aa019f7f4 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:50.830938 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b865194-1647-4d02-95b9-c410a4e030d3 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:50.853889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:50.861359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb6ad5-c794-40e3-9595-d7d18226ba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:50.862053 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb6ad5-c794-40e3-9595-d7d18226ba69 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:50.862439 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb6ad5-c794-40e3-9595-d7d18226ba69 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:50.862733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb6ad5-c794-40e3-9595-d7d18226ba69 None admin] PATH_INFO: `/v3/groups/3c29b3720ef84e349a5d872eb0a23905` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:50.864109 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb6ad5-c794-40e3-9595-d7d18226ba69 None admin] RBAC: Authorizing `identity:get_group(group_id=3c29b3720ef84e349a5d872eb0a23905)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:50.865542 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb6ad5-c794-40e3-9595-d7d18226ba69 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:50.867155 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 199/409] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:50 2022] GET /identity/v3/groups/3c29b3720ef84e349a5d872eb0a23905 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:50.867905 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb6ad5-c794-40e3-9595-d7d18226ba69 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:50.868465 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eb6ce-dec0-43f6-be29-8300a11703d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:50.869271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eb6ce-dec0-43f6-be29-8300a11703d1 None admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:50.869621 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eb6ce-dec0-43f6-be29-8300a11703d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:50.869967 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eb6ce-dec0-43f6-be29-8300a11703d1 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d/groups/3c29b3720ef84e349a5d872eb0a23905/roles/5717836a50094587b879206794e7156a` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:50.872041 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eb6ce-dec0-43f6-be29-8300a11703d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=589bd0360e7e41baa7c699b6e9e5be9d, group_id=3c29b3720ef84e349a5d872eb0a23905, role_id=5717836a50094587b879206794e7156a)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:50.874319 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eb6ce-dec0-43f6-be29-8300a11703d1 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:50.898198 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 211/410] 10.222.0.65 () {58 vars in 1442 bytes} [Mon Jul 25 23:58:50 2022] PUT /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d/groups/3c29b3720ef84e349a5d872eb0a23905/roles/5717836a50094587b879206794e7156a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:58:50.904399 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eb6ce-dec0-43f6-be29-8300a11703d1 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:51.068265 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb6ad5-c794-40e3-9595-d7d18226ba69 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:51.119577 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8aadf-eb27-4c4d-a1ba-fd019b0c9be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:51.120583 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8aadf-eb27-4c4d-a1ba-fd019b0c9be0 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:51.121454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8aadf-eb27-4c4d-a1ba-fd019b0c9be0 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:51.122262 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8aadf-eb27-4c4d-a1ba-fd019b0c9be0 None admin] PATH_INFO: `/v3/groups/535cff6c5b3445a28f1bd72938b548e0` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:51.124511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8aadf-eb27-4c4d-a1ba-fd019b0c9be0 None admin] RBAC: Authorizing `identity:get_group(group_id=535cff6c5b3445a28f1bd72938b548e0)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:51.126479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8aadf-eb27-4c4d-a1ba-fd019b0c9be0 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:51.129954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 200/411] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:50 2022] GET /identity/v3/groups/535cff6c5b3445a28f1bd72938b548e0 => generated 229 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:51.134900 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eb6ce-dec0-43f6-be29-8300a11703d1 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:51.135075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8aadf-eb27-4c4d-a1ba-fd019b0c9be0 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:51.156127 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:51.174335 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d6f7a-2306-461d-9682-770110fe7ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:51.175252 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d6f7a-2306-461d-9682-770110fe7ca9 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:51.175704 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d6f7a-2306-461d-9682-770110fe7ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:51.176121 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d6f7a-2306-461d-9682-770110fe7ca9 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:51.177423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d6f7a-2306-461d-9682-770110fe7ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:51.179040 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d6f7a-2306-461d-9682-770110fe7ca9 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:51.181423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 212/412] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:50 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:51.189249 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d6f7a-2306-461d-9682-770110fe7ca9 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:51.272772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:51.285421 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8aadf-eb27-4c4d-a1ba-fd019b0c9be0 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:51.330148 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d6f7a-2306-461d-9682-770110fe7ca9 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:51.335889 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd79cde-e11e-4c89-b67f-59a1cdace126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:51.336540 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd79cde-e11e-4c89-b67f-59a1cdace126 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:51.336824 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd79cde-e11e-4c89-b67f-59a1cdace126 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:51.337099 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd79cde-e11e-4c89-b67f-59a1cdace126 None admin] PATH_INFO: `/v3/projects/a89d9c4e1862458dba91de9a0e7a6b24` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:51.338267 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd79cde-e11e-4c89-b67f-59a1cdace126 None admin] RBAC: Authorizing `identity:get_project(project_id=a89d9c4e1862458dba91de9a0e7a6b24)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:51.339802 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd79cde-e11e-4c89-b67f-59a1cdace126 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:51.342468 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 201/413] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:51 2022] GET /identity/v3/projects/a89d9c4e1862458dba91de9a0e7a6b24 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:51.349526 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd79cde-e11e-4c89-b67f-59a1cdace126 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:51.382217 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168c3cc-003a-4628-9399-33fca4654afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:51.383314 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168c3cc-003a-4628-9399-33fca4654afa None admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:51.383788 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168c3cc-003a-4628-9399-33fca4654afa None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:51.384319 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168c3cc-003a-4628-9399-33fca4654afa None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d/groups/3c29b3720ef84e349a5d872eb0a23905/roles/c88cff91a5454c9ea5c03c9eb0a7a2aa` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:51.394733 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168c3cc-003a-4628-9399-33fca4654afa None admin] RBAC: Authorizing `identity:create_grant(project_id=589bd0360e7e41baa7c699b6e9e5be9d, group_id=3c29b3720ef84e349a5d872eb0a23905, role_id=c88cff91a5454c9ea5c03c9eb0a7a2aa)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:51.396692 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168c3cc-003a-4628-9399-33fca4654afa None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:51.418607 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 213/414] 10.222.0.65 () {58 vars in 1442 bytes} [Mon Jul 25 23:58:51 2022] PUT /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d/groups/3c29b3720ef84e349a5d872eb0a23905/roles/c88cff91a5454c9ea5c03c9eb0a7a2aa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:58:51.471435 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:51.497179 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd79cde-e11e-4c89-b67f-59a1cdace126 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:51.543217 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6af4e-3664-41c5-9eac-f2e365060c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:51.543938 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6af4e-3664-41c5-9eac-f2e365060c1e None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:51.544773 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6af4e-3664-41c5-9eac-f2e365060c1e None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:51.545116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6af4e-3664-41c5-9eac-f2e365060c1e None admin] PATH_INFO: `/v3/projects/a89d9c4e1862458dba91de9a0e7a6b24/groups/535cff6c5b3445a28f1bd72938b548e0/roles/5d947b934e0642c5a4ab00d547ec3fda` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:51.547501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6af4e-3664-41c5-9eac-f2e365060c1e None admin] RBAC: Authorizing `identity:create_grant(project_id=a89d9c4e1862458dba91de9a0e7a6b24, group_id=535cff6c5b3445a28f1bd72938b548e0, role_id=5d947b934e0642c5a4ab00d547ec3fda)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:51.549061 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6af4e-3664-41c5-9eac-f2e365060c1e None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:51.569747 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 202/415] 10.222.0.65 () {58 vars in 1442 bytes} [Mon Jul 25 23:58:51 2022] PUT /identity/v3/projects/a89d9c4e1862458dba91de9a0e7a6b24/groups/535cff6c5b3445a28f1bd72938b548e0/roles/5d947b934e0642c5a4ab00d547ec3fda => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:58:51.801709 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72522d10-2939-4c1b-b91a-c4dfc7c00013 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:51.802798 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72522d10-2939-4c1b-b91a-c4dfc7c00013 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:51.803302 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72522d10-2939-4c1b-b91a-c4dfc7c00013 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:51.805388 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 214/416] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:51.811075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d49b2-102e-41db-b754-e75c81998b3c None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:51.811975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d49b2-102e-41db-b754-e75c81998b3c None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:51.812449 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d49b2-102e-41db-b754-e75c81998b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:51.832791 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-b15d49b2-102e-41db-b754-e75c81998b3c None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:51.833999 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-b15d49b2-102e-41db-b754-e75c81998b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:51.910842 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 203/417] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:51.931253 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72522d10-2939-4c1b-b91a-c4dfc7c00013 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:51.947206 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de15e3-1047-431f-b08e-a45b9a4c6489 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:51.947535 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de15e3-1047-431f-b08e-a45b9a4c6489 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:51.947769 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de15e3-1047-431f-b08e-a45b9a4c6489 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:51.949460 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 204/418] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:51.954416 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe6bfd-7241-4803-b2f7-cca998908986 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:51.954933 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe6bfd-7241-4803-b2f7-cca998908986 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:51.955349 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe6bfd-7241-4803-b2f7-cca998908986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:51.975604 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-5dbe6bfd-7241-4803-b2f7-cca998908986 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:51.977062 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-5dbe6bfd-7241-4803-b2f7-cca998908986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:52.046434 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:52.068510 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 205/419] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:52.094660 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72522d10-2939-4c1b-b91a-c4dfc7c00013 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:52.105362 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:52.115190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe6bfd-7241-4803-b2f7-cca998908986 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:52.134743 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f05f3-ea6f-46b7-9722-e4335cbc9a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:52.135395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f05f3-ea6f-46b7-9722-e4335cbc9a31 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:52.135669 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f05f3-ea6f-46b7-9722-e4335cbc9a31 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:52.135941 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f05f3-ea6f-46b7-9722-e4335cbc9a31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:52.146690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f05f3-ea6f-46b7-9722-e4335cbc9a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-f80f05f3-ea6f-46b7-9722-e4335cbc9a31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:52.152116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:52.152992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:52.154545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 215/420] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:52.160004 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f05f3-ea6f-46b7-9722-e4335cbc9a31 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:52.279401 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f05f3-ea6f-46b7-9722-e4335cbc9a31 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:52.316512 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe6bfd-7241-4803-b2f7-cca998908986 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:52.331771 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207effe9-22f0-47a0-8695-f952f91ecfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:52.332313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207effe9-22f0-47a0-8695-f952f91ecfa9 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:52.332592 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207effe9-22f0-47a0-8695-f952f91ecfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:52.332867 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207effe9-22f0-47a0-8695-f952f91ecfa9 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:52.333642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207effe9-22f0-47a0-8695-f952f91ecfa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:52.333943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207effe9-22f0-47a0-8695-f952f91ecfa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:52.335435 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207effe9-22f0-47a0-8695-f952f91ecfa9 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:52.346750 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 216/421] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:52.351863 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207effe9-22f0-47a0-8695-f952f91ecfa9 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:52.397463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:52.441173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182329ca-a625-4d25-b094-f0fb4ae7f30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:52.442126 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182329ca-a625-4d25-b094-f0fb4ae7f30f None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:52.442613 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182329ca-a625-4d25-b094-f0fb4ae7f30f None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:52.443115 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182329ca-a625-4d25-b094-f0fb4ae7f30f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:52.454688 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182329ca-a625-4d25-b094-f0fb4ae7f30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-182329ca-a625-4d25-b094-f0fb4ae7f30f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:52.460459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:52.461322 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:52.462140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:52.462140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:52.462140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:52.462140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:52.462140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:52.462140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:52.462140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:52.462140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:52.462140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:52.462140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:52.462140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:52.462140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:52.464578 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 206/422] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:58:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:52.470488 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182329ca-a625-4d25-b094-f0fb4ae7f30f None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:52.512849 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207effe9-22f0-47a0-8695-f952f91ecfa9 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:52.539275 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:52.580429 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2ca7d-564f-48a2-a4bc-8e83885aaf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:52.581579 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2ca7d-564f-48a2-a4bc-8e83885aaf62 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:52.582107 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2ca7d-564f-48a2-a4bc-8e83885aaf62 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:52.582568 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2ca7d-564f-48a2-a4bc-8e83885aaf62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:52.616836 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182329ca-a625-4d25-b094-f0fb4ae7f30f None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:52.657529 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2ca7d-564f-48a2-a4bc-8e83885aaf62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:52.659553 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2ca7d-564f-48a2-a4bc-8e83885aaf62 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:52.692363 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:52.717470 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58177468-a9b0-4ab4-ac74-bc8d572afa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:52.718193 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58177468-a9b0-4ab4-ac74-bc8d572afa54 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:52.718368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58177468-a9b0-4ab4-ac74-bc8d572afa54 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:52.718650 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58177468-a9b0-4ab4-ac74-bc8d572afa54 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:52.719398 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58177468-a9b0-4ab4-ac74-bc8d572afa54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:52.719705 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58177468-a9b0-4ab4-ac74-bc8d572afa54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:52.721097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58177468-a9b0-4ab4-ac74-bc8d572afa54 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:52.745351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 207/423] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:58:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:52.750975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58177468-a9b0-4ab4-ac74-bc8d572afa54 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:52.770244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 217/424] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 23:58:52.776178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2ca7d-564f-48a2-a4bc-8e83885aaf62 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:52.887722 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2ca7d-564f-48a2-a4bc-8e83885aaf62 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:52.947089 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:52.956395 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58177468-a9b0-4ab4-ac74-bc8d572afa54 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:52.958218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d2186-12d8-44b8-bade-728ac39bbb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:52.959176 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d2186-12d8-44b8-bade-728ac39bbb44 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:52.960907 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d2186-12d8-44b8-bade-728ac39bbb44 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:52.961380 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d2186-12d8-44b8-bade-728ac39bbb44 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:52.962914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d2186-12d8-44b8-bade-728ac39bbb44 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:52.965424 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d2186-12d8-44b8-bade-728ac39bbb44 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:52.975052 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 218/425] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:52 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:52.978541 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d2186-12d8-44b8-bade-728ac39bbb44 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:53.015096 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:53.026024 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0e00a-ed07-4c39-8da1-852607deafd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:53.026727 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e00a-ed07-4c39-8da1-852607deafd1 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:53.027124 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e00a-ed07-4c39-8da1-852607deafd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:53.027511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e00a-ed07-4c39-8da1-852607deafd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:53.102514 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0e00a-ed07-4c39-8da1-852607deafd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:53.104305 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0e00a-ed07-4c39-8da1-852607deafd1 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:53.218628 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 208/426] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:53.224930 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0e00a-ed07-4c39-8da1-852607deafd1 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:53.231483 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d2186-12d8-44b8-bade-728ac39bbb44 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:53.267044 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:53.305741 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42180b-666b-4035-b6d8-a793e519087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:53.306780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42180b-666b-4035-b6d8-a793e519087b None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:53.307352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42180b-666b-4035-b6d8-a793e519087b None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:53.307834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42180b-666b-4035-b6d8-a793e519087b None admin] PATH_INFO: `/v3/groups/3c29b3720ef84e349a5d872eb0a23905` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:53.311224 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42180b-666b-4035-b6d8-a793e519087b None admin] RBAC: Authorizing `identity:get_group(group_id=3c29b3720ef84e349a5d872eb0a23905)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:53.312943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42180b-666b-4035-b6d8-a793e519087b None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:53.315488 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 219/427] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:52 2022] GET /identity/v3/groups/3c29b3720ef84e349a5d872eb0a23905 => generated 226 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:53.321442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42180b-666b-4035-b6d8-a793e519087b None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:53.353219 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0e00a-ed07-4c39-8da1-852607deafd1 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:53.389462 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64d80e-366a-4d7e-9d35-1953b446e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:53.390156 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64d80e-366a-4d7e-9d35-1953b446e366 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:53.390486 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64d80e-366a-4d7e-9d35-1953b446e366 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:53.390793 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64d80e-366a-4d7e-9d35-1953b446e366 None admin] PATH_INFO: `/v3/projects/c21bfcd3302f46909780c42e4b2d702d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:53.391977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64d80e-366a-4d7e-9d35-1953b446e366 None admin] RBAC: Authorizing `identity:get_project(project_id=c21bfcd3302f46909780c42e4b2d702d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:53.393439 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64d80e-366a-4d7e-9d35-1953b446e366 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:53.395484 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 209/428] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:53 2022] GET /identity/v3/projects/c21bfcd3302f46909780c42e4b2d702d => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:53.406249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64d80e-366a-4d7e-9d35-1953b446e366 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:53.428596 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:53.468116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42180b-666b-4035-b6d8-a793e519087b None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:53.505094 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e9339-81f9-4a96-9556-436dea9c5f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:53.505634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e9339-81f9-4a96-9556-436dea9c5f3d None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:53.505923 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e9339-81f9-4a96-9556-436dea9c5f3d None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:53.506204 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e9339-81f9-4a96-9556-436dea9c5f3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:53.507154 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e9339-81f9-4a96-9556-436dea9c5f3d None admin] RBAC: Adding query filter params (group.id=3c29b3720ef84e349a5d872eb0a23905, role.id=5717836a50094587b879206794e7156a, scope.project.id=c21bfcd3302f46909780c42e4b2d702d) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:53.507481 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e9339-81f9-4a96-9556-436dea9c5f3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:53.508921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e9339-81f9-4a96-9556-436dea9c5f3d None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:53.515754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 220/429] 10.222.0.65 () {56 vars in 1376 bytes} [Mon Jul 25 23:58:53 2022] GET /identity/v3/role_assignments?group.id=3c29b3720ef84e349a5d872eb0a23905&scope.project.id=c21bfcd3302f46909780c42e4b2d702d&role.id=5717836a50094587b879206794e7156a => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:53.610151 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9f3f8-91c6-47bb-8124-e57df254793c None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:53.611300 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9f3f8-91c6-47bb-8124-e57df254793c None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:53.611811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9f3f8-91c6-47bb-8124-e57df254793c None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:53.614055 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 221/430] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:58:53.620881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be734d0-a18d-49c4-b807-f5163889885b None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:53.621488 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be734d0-a18d-49c4-b807-f5163889885b None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:53.621967 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be734d0-a18d-49c4-b807-f5163889885b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:53.646257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-2be734d0-a18d-49c4-b807-f5163889885b None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:53.648327 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-2be734d0-a18d-49c4-b807-f5163889885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:53.659045 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:53.675264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64d80e-366a-4d7e-9d35-1953b446e366 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:53.744854 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 222/431] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:53.772186 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be734d0-a18d-49c4-b807-f5163889885b None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:53.777603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8a2ce-9b52-48f5-8ee0-dfd34cc98c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:53.778262 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8a2ce-9b52-48f5-8ee0-dfd34cc98c10 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:53.778575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8a2ce-9b52-48f5-8ee0-dfd34cc98c10 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:53.778956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8a2ce-9b52-48f5-8ee0-dfd34cc98c10 None admin] PATH_INFO: `/v3/groups/3c29b3720ef84e349a5d872eb0a23905` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:53.780183 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8a2ce-9b52-48f5-8ee0-dfd34cc98c10 None admin] RBAC: Authorizing `identity:get_group(group_id=3c29b3720ef84e349a5d872eb0a23905)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:53.781654 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8a2ce-9b52-48f5-8ee0-dfd34cc98c10 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:53.783441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 210/432] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:53 2022] GET /identity/v3/groups/3c29b3720ef84e349a5d872eb0a23905 => generated 226 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:53.789344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8a2ce-9b52-48f5-8ee0-dfd34cc98c10 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:53.841853 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:53.884290 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be734d0-a18d-49c4-b807-f5163889885b None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:53.923702 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b418795-caa2-40b9-abc2-ea0084b96d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:53.925204 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b418795-caa2-40b9-abc2-ea0084b96d4a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:53.925732 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b418795-caa2-40b9-abc2-ea0084b96d4a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:53.926210 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b418795-caa2-40b9-abc2-ea0084b96d4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:53.938095 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b418795-caa2-40b9-abc2-ea0084b96d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:53.941543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8a2ce-9b52-48f5-8ee0-dfd34cc98c10 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-5b418795-caa2-40b9-abc2-ea0084b96d4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:53.943642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:53.944509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:53.945328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:53.945328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:53.945328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:53.945328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:53.945328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:53.945328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:53.945328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:53.945328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:53.945328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:53.945328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:53.945328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 23:58:53.945328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:53.947957 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 223/433] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:53.955383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b418795-caa2-40b9-abc2-ea0084b96d4a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:54.000074 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5fe6b-5d98-4c8b-a985-5b40e368e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:54.000718 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5fe6b-5d98-4c8b-a985-5b40e368e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:54.000979 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5fe6b-5d98-4c8b-a985-5b40e368e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:54.001261 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5fe6b-5d98-4c8b-a985-5b40e368e7d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:54.002051 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5fe6b-5d98-4c8b-a985-5b40e368e7d2 None admin] RBAC: Adding query filter params (group.id=3c29b3720ef84e349a5d872eb0a23905, role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa, scope.project.id=c21bfcd3302f46909780c42e4b2d702d) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:54.002361 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5fe6b-5d98-4c8b-a985-5b40e368e7d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:54.004588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5fe6b-5d98-4c8b-a985-5b40e368e7d2 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:54.011917 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 211/434] 10.222.0.65 () {56 vars in 1376 bytes} [Mon Jul 25 23:58:53 2022] GET /identity/v3/role_assignments?group.id=3c29b3720ef84e349a5d872eb0a23905&scope.project.id=c21bfcd3302f46909780c42e4b2d702d&role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa => generated 611 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:54.073591 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b418795-caa2-40b9-abc2-ea0084b96d4a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:54.102223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:54.116478 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84d12c-e8b2-4e3b-9ec1-c3f8c07aede1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:54.117501 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84d12c-e8b2-4e3b-9ec1-c3f8c07aede1 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:54.117978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84d12c-e8b2-4e3b-9ec1-c3f8c07aede1 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:54.118449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84d12c-e8b2-4e3b-9ec1-c3f8c07aede1 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:54.119452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84d12c-e8b2-4e3b-9ec1-c3f8c07aede1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:54.119959 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84d12c-e8b2-4e3b-9ec1-c3f8c07aede1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:54.121580 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84d12c-e8b2-4e3b-9ec1-c3f8c07aede1 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:54.133309 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 224/435] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:58:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:54.140405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5fe6b-5d98-4c8b-a985-5b40e368e7d2 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:54.172476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:54.260561 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5fe6b-5d98-4c8b-a985-5b40e368e7d2 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:54.306847 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094434-1165-4060-8647-b5e5296af81e None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:54.307581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094434-1165-4060-8647-b5e5296af81e None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:54.308109 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094434-1165-4060-8647-b5e5296af81e None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:54.309020 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba48963-dffc-48c5-a012-15fe02d411ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:54.309721 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba48963-dffc-48c5-a012-15fe02d411ce None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:54.310059 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba48963-dffc-48c5-a012-15fe02d411ce None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:54.310589 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba48963-dffc-48c5-a012-15fe02d411ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:54.310810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 225/436] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:54.316783 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beafcdb-5dd9-411f-b7ce-2af94bef02b1 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:54.317069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beafcdb-5dd9-411f-b7ce-2af94bef02b1 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:54.317349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beafcdb-5dd9-411f-b7ce-2af94bef02b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:54.344301 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-1beafcdb-5dd9-411f-b7ce-2af94bef02b1 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:54.345442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-1beafcdb-5dd9-411f-b7ce-2af94bef02b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:54.398879 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba48963-dffc-48c5-a012-15fe02d411ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:54.400482 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba48963-dffc-48c5-a012-15fe02d411ce None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:54.426087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:54.427493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 226/437] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:54.452388 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beafcdb-5dd9-411f-b7ce-2af94bef02b1 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:54.530051 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 212/438] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:54.530051 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af203e-a25b-482b-bff7-1d8e70de830c None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:54.530051 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af203e-a25b-482b-bff7-1d8e70de830c None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:54.530051 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af203e-a25b-482b-bff7-1d8e70de830c None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:54.530051 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 213/439] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:54.532271 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af203e-a25b-482b-bff7-1d8e70de830c None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:54.573536 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beafcdb-5dd9-411f-b7ce-2af94bef02b1 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:54.593969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:54.616113 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22362a1-04d2-478f-8568-79bf065ce3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:54.616685 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22362a1-04d2-478f-8568-79bf065ce3a5 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:54.616966 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22362a1-04d2-478f-8568-79bf065ce3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:54.617243 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22362a1-04d2-478f-8568-79bf065ce3a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:54.627596 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22362a1-04d2-478f-8568-79bf065ce3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-c22362a1-04d2-478f-8568-79bf065ce3a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:54.632489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:54.633406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:54.634223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 227/440] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:54.634904 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd01b2-9552-4060-bf0a-0267027919c3 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:54.635126 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd01b2-9552-4060-bf0a-0267027919c3 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:54.635396 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd01b2-9552-4060-bf0a-0267027919c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:54.652321 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af203e-a25b-482b-bff7-1d8e70de830c None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:54.654624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-31dd01b2-9552-4060-bf0a-0267027919c3 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:54.655684 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-31dd01b2-9552-4060-bf0a-0267027919c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:54.675715 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:54.687446 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b3bd1-4797-4a16-bf00-1f366cbef922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:54.688079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b3bd1-4797-4a16-bf00-1f366cbef922 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:54.688360 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b3bd1-4797-4a16-bf00-1f366cbef922 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:54.688642 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b3bd1-4797-4a16-bf00-1f366cbef922 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:54.689827 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b3bd1-4797-4a16-bf00-1f366cbef922 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:54.691396 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b3bd1-4797-4a16-bf00-1f366cbef922 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:54.693035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 214/441] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:54 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:54.693784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b3bd1-4797-4a16-bf00-1f366cbef922 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:54.728063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 228/442] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:54.729178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd01b2-9552-4060-bf0a-0267027919c3 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:54.803029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b3bd1-4797-4a16-bf00-1f366cbef922 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:54.836308 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd01b2-9552-4060-bf0a-0267027919c3 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:54.836869 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d497bfd-2201-4fdc-a198-161b0de2d505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:54.837483 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d497bfd-2201-4fdc-a198-161b0de2d505 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:54.837830 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d497bfd-2201-4fdc-a198-161b0de2d505 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:54.838109 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d497bfd-2201-4fdc-a198-161b0de2d505 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:54.838600 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:54.838852 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d497bfd-2201-4fdc-a198-161b0de2d505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:54.839155 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d497bfd-2201-4fdc-a198-161b0de2d505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:54.840531 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d497bfd-2201-4fdc-a198-161b0de2d505 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:54.848806 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 215/443] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:54.849602 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d497bfd-2201-4fdc-a198-161b0de2d505 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:54.874831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a9159-a348-46dc-9141-e585f5f5e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:54.875396 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a9159-a348-46dc-9141-e585f5f5e321 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:54.875779 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a9159-a348-46dc-9141-e585f5f5e321 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:54.875938 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a9159-a348-46dc-9141-e585f5f5e321 None admin] PATH_INFO: `/v3/groups/3c29b3720ef84e349a5d872eb0a23905` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:54.877308 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a9159-a348-46dc-9141-e585f5f5e321 None admin] RBAC: Authorizing `identity:get_group(group_id=3c29b3720ef84e349a5d872eb0a23905)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:54.878755 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a9159-a348-46dc-9141-e585f5f5e321 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:54.880321 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 229/444] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:54 2022] GET /identity/v3/groups/3c29b3720ef84e349a5d872eb0a23905 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:54.881065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a9159-a348-46dc-9141-e585f5f5e321 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:54.903047 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:54.950167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d497bfd-2201-4fdc-a198-161b0de2d505 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:54.982825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a9159-a348-46dc-9141-e585f5f5e321 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:54.987344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff0488-dbb7-4409-92de-7aa85335269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:54.987984 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff0488-dbb7-4409-92de-7aa85335269b None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:54.988264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff0488-dbb7-4409-92de-7aa85335269b None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:54.988537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff0488-dbb7-4409-92de-7aa85335269b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:54.999545 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff0488-dbb7-4409-92de-7aa85335269b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-9aff0488-dbb7-4409-92de-7aa85335269b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:58:55.004775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:55.006147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 216/445] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:58:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:55.006981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff0488-dbb7-4409-92de-7aa85335269b None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:55.023583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84ecbb-327f-42e5-8426-c5f1d7358993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:55.024199 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84ecbb-327f-42e5-8426-c5f1d7358993 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:55.024480 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84ecbb-327f-42e5-8426-c5f1d7358993 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:55.024755 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84ecbb-327f-42e5-8426-c5f1d7358993 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:55.067241 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:55.094681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84ecbb-327f-42e5-8426-c5f1d7358993 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:55.096166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84ecbb-327f-42e5-8426-c5f1d7358993 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:55.105386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff0488-dbb7-4409-92de-7aa85335269b None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:55.117880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:55.139594 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cb325-41cf-4e5a-879c-297bb5f9a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:55.140128 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cb325-41cf-4e5a-879c-297bb5f9a142 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:55.140406 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cb325-41cf-4e5a-879c-297bb5f9a142 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:55.140681 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cb325-41cf-4e5a-879c-297bb5f9a142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:55.141448 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cb325-41cf-4e5a-879c-297bb5f9a142 None admin] RBAC: Adding query filter params (group.id=3c29b3720ef84e349a5d872eb0a23905, role.id=5717836a50094587b879206794e7156a, scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:55.141756 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cb325-41cf-4e5a-879c-297bb5f9a142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:55.143223 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cb325-41cf-4e5a-879c-297bb5f9a142 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:55.148779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 217/446] 10.222.0.65 () {56 vars in 1376 bytes} [Mon Jul 25 23:58:55 2022] GET /identity/v3/role_assignments?group.id=3c29b3720ef84e349a5d872eb0a23905&scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d&role.id=5717836a50094587b879206794e7156a => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:55.149546 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cb325-41cf-4e5a-879c-297bb5f9a142 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:55.204055 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 230/447] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:58:55.209905 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84ecbb-327f-42e5-8426-c5f1d7358993 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:55.266981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cb325-41cf-4e5a-879c-297bb5f9a142 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:55.290675 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:55.310381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197836c7-e455-405c-9751-4cbcc40c19a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:55.311046 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197836c7-e455-405c-9751-4cbcc40c19a5 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:55.311339 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197836c7-e455-405c-9751-4cbcc40c19a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:55.311616 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197836c7-e455-405c-9751-4cbcc40c19a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:55.312343 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197836c7-e455-405c-9751-4cbcc40c19a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:55.312651 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197836c7-e455-405c-9751-4cbcc40c19a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:55.314051 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197836c7-e455-405c-9751-4cbcc40c19a5 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:55.322765 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 218/448] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:58:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:55.329613 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197836c7-e455-405c-9751-4cbcc40c19a5 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:55.330866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84ecbb-327f-42e5-8426-c5f1d7358993 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:55.373560 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad4aa6-fb45-4b6b-8792-18e787febf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:55.374215 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad4aa6-fb45-4b6b-8792-18e787febf0a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:55.374507 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad4aa6-fb45-4b6b-8792-18e787febf0a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:55.374819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad4aa6-fb45-4b6b-8792-18e787febf0a None admin] PATH_INFO: `/v3/projects/a89d9c4e1862458dba91de9a0e7a6b24` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:55.375992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad4aa6-fb45-4b6b-8792-18e787febf0a None admin] RBAC: Authorizing `identity:get_project(project_id=a89d9c4e1862458dba91de9a0e7a6b24)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:55.377453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad4aa6-fb45-4b6b-8792-18e787febf0a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:55.378770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:55.379227 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 231/449] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:55 2022] GET /identity/v3/projects/a89d9c4e1862458dba91de9a0e7a6b24 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:55.384960 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad4aa6-fb45-4b6b-8792-18e787febf0a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:55.454050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197836c7-e455-405c-9751-4cbcc40c19a5 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:55.496116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeab224-067a-49a2-98f6-40e8af28a644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:55.496735 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeab224-067a-49a2-98f6-40e8af28a644 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:55.497015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeab224-067a-49a2-98f6-40e8af28a644 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:55.497467 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad4aa6-fb45-4b6b-8792-18e787febf0a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:55.497585 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeab224-067a-49a2-98f6-40e8af28a644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:55.538995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d105f-78f2-4475-b0bb-5fb6dbfb3ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:55.539638 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d105f-78f2-4475-b0bb-5fb6dbfb3ac0 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:55.539916 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d105f-78f2-4475-b0bb-5fb6dbfb3ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:55.540190 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d105f-78f2-4475-b0bb-5fb6dbfb3ac0 None admin] PATH_INFO: `/v3/groups/535cff6c5b3445a28f1bd72938b548e0` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:55.541340 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d105f-78f2-4475-b0bb-5fb6dbfb3ac0 None admin] RBAC: Authorizing `identity:get_group(group_id=535cff6c5b3445a28f1bd72938b548e0)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:55.542871 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d105f-78f2-4475-b0bb-5fb6dbfb3ac0 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:55.544732 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 232/450] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:55 2022] GET /identity/v3/groups/535cff6c5b3445a28f1bd72938b548e0 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:55.550465 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d105f-78f2-4475-b0bb-5fb6dbfb3ac0 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:55.561882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:55.570766 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeab224-067a-49a2-98f6-40e8af28a644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:55.572240 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeab224-067a-49a2-98f6-40e8af28a644 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:55.609526 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:55.651085 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d105f-78f2-4475-b0bb-5fb6dbfb3ac0 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:55.669539 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 219/451] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 23:58:55.675245 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeab224-067a-49a2-98f6-40e8af28a644 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:55.683967 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59736089-28b5-4e69-8c9a-78baa3325c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:55.685123 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59736089-28b5-4e69-8c9a-78baa3325c57 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:55.685420 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59736089-28b5-4e69-8c9a-78baa3325c57 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:55.685693 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59736089-28b5-4e69-8c9a-78baa3325c57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:55.686623 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59736089-28b5-4e69-8c9a-78baa3325c57 None admin] RBAC: Adding query filter params (group.id=535cff6c5b3445a28f1bd72938b548e0, role.id=5d947b934e0642c5a4ab00d547ec3fda, scope.project.id=a89d9c4e1862458dba91de9a0e7a6b24) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:55.686958 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59736089-28b5-4e69-8c9a-78baa3325c57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:55.688367 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59736089-28b5-4e69-8c9a-78baa3325c57 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:55.693957 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 233/452] 10.222.0.65 () {56 vars in 1376 bytes} [Mon Jul 25 23:58:55 2022] GET /identity/v3/role_assignments?group.id=535cff6c5b3445a28f1bd72938b548e0&scope.project.id=a89d9c4e1862458dba91de9a0e7a6b24&role.id=5d947b934e0642c5a4ab00d547ec3fda => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:55.779264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeab224-067a-49a2-98f6-40e8af28a644 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:55.815026 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8ae35-949a-4705-b143-e16eba3865a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:55.815679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ae35-949a-4705-b143-e16eba3865a6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:55.815961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ae35-949a-4705-b143-e16eba3865a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:55.816238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ae35-949a-4705-b143-e16eba3865a6 None admin] PATH_INFO: `/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:55.817430 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8ae35-949a-4705-b143-e16eba3865a6 None admin] RBAC: Authorizing `identity:get_project(project_id=589bd0360e7e41baa7c699b6e9e5be9d)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:55.818937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8ae35-949a-4705-b143-e16eba3865a6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:55.820647 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 220/453] 10.222.0.65 () {56 vars in 1186 bytes} [Mon Jul 25 23:58:55 2022] GET /identity/v3/projects/589bd0360e7e41baa7c699b6e9e5be9d => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:55.826983 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59736089-28b5-4e69-8c9a-78baa3325c57 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:55.901268 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:55.932539 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59736089-28b5-4e69-8c9a-78baa3325c57 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:55.965112 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa8d84-fa40-4ba0-ac0a-eca17f55dcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:55.965748 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa8d84-fa40-4ba0-ac0a-eca17f55dcf7 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:55.966070 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa8d84-fa40-4ba0-ac0a-eca17f55dcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:55.966939 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa8d84-fa40-4ba0-ac0a-eca17f55dcf7 None admin] PATH_INFO: `/v3/groups/3c29b3720ef84e349a5d872eb0a23905` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:55.968018 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa8d84-fa40-4ba0-ac0a-eca17f55dcf7 None admin] RBAC: Authorizing `identity:get_group(group_id=3c29b3720ef84e349a5d872eb0a23905)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:55.969455 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa8d84-fa40-4ba0-ac0a-eca17f55dcf7 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:55.971076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 234/454] 10.222.0.65 () {56 vars in 1180 bytes} [Mon Jul 25 23:58:55 2022] GET /identity/v3/groups/3c29b3720ef84e349a5d872eb0a23905 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:58:55.976957 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8ae35-949a-4705-b143-e16eba3865a6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:55.985706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:56.074965 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8ae35-949a-4705-b143-e16eba3865a6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:56.108470 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315109c9-218a-456e-9de1-71a2549016eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:56.109070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315109c9-218a-456e-9de1-71a2549016eb None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:56.109350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315109c9-218a-456e-9de1-71a2549016eb None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:56.109623 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315109c9-218a-456e-9de1-71a2549016eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:56.110393 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315109c9-218a-456e-9de1-71a2549016eb None admin] RBAC: Adding query filter params (group.id=3c29b3720ef84e349a5d872eb0a23905, role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa, scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:56.110701 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315109c9-218a-456e-9de1-71a2549016eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:56.112159 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315109c9-218a-456e-9de1-71a2549016eb None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:56.117742 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 221/455] 10.222.0.65 () {56 vars in 1376 bytes} [Mon Jul 25 23:58:55 2022] GET /identity/v3/role_assignments?group.id=3c29b3720ef84e349a5d872eb0a23905&scope.project.id=589bd0360e7e41baa7c699b6e9e5be9d&role.id=c88cff91a5454c9ea5c03c9eb0a7a2aa => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:58.777446 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742e7ef-d540-43c1-97d8-0a32a3ce718a None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:58.778750 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742e7ef-d540-43c1-97d8-0a32a3ce718a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:58.779359 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742e7ef-d540-43c1-97d8-0a32a3ce718a None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:58.781474 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 235/456] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:58.788015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3692f-d081-432a-bdea-e7b833574fe8 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:58.789070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3692f-d081-432a-bdea-e7b833574fe8 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:58.789542 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3692f-d081-432a-bdea-e7b833574fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:58.815525 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-c1a3692f-d081-432a-bdea-e7b833574fe8 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:58.817065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-c1a3692f-d081-432a-bdea-e7b833574fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:58.882660 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:58.890098 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 222/457] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:58:58.915608 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742e7ef-d540-43c1-97d8-0a32a3ce718a None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:58.934631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48896650-217a-47f1-beef-fb13467b2f47 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:58.934964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48896650-217a-47f1-beef-fb13467b2f47 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:58.935218 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48896650-217a-47f1-beef-fb13467b2f47 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:58.936814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 223/458] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:58.942474 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c3681-f640-4e0e-987f-357ba3910574 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:58.942811 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c3681-f640-4e0e-987f-357ba3910574 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:58.943079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c3681-f640-4e0e-987f-357ba3910574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:58.962632 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-b36c3681-f640-4e0e-987f-357ba3910574 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:58.963961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-b36c3681-f640-4e0e-987f-357ba3910574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:59.034243 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742e7ef-d540-43c1-97d8-0a32a3ce718a None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:59.054972 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 224/459] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:59.073361 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a0e53-21b9-4422-b659-74a697451bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:59.074365 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a0e53-21b9-4422-b659-74a697451bd2 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:59.074955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a0e53-21b9-4422-b659-74a697451bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:59.075275 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c3681-f640-4e0e-987f-357ba3910574 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:59.075704 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a0e53-21b9-4422-b659-74a697451bd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:59.085504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:59.087966 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a0e53-21b9-4422-b659-74a697451bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:59.089700 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a0e53-21b9-4422-b659-74a697451bd2 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-4c8a0e53-21b9-4422-b659-74a697451bd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:58:59.105558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:59.107247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:59.108079 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:58:59.108079 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:58:59.108079 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:58:59.108079 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:59.108079 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 236/460] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:59.113970 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a0e53-21b9-4422-b659-74a697451bd2 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:59.208737 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c3681-f640-4e0e-987f-357ba3910574 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:59.226989 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a0e53-21b9-4422-b659-74a697451bd2 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:59.247912 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:59.254783 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48f27-f41e-48f1-a00a-50a7799dc84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:59.255428 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48f27-f41e-48f1-a00a-50a7799dc84e None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:59.255713 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48f27-f41e-48f1-a00a-50a7799dc84e None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:59.255990 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48f27-f41e-48f1-a00a-50a7799dc84e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:59.261708 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0daa50-1c96-4193-b44a-920d05537308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:59.262321 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0daa50-1c96-4193-b44a-920d05537308 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:59.263233 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0daa50-1c96-4193-b44a-920d05537308 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:59.264056 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0daa50-1c96-4193-b44a-920d05537308 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:59.264748 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0daa50-1c96-4193-b44a-920d05537308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:59.265054 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0daa50-1c96-4193-b44a-920d05537308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:59.266422 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0daa50-1c96-4193-b44a-920d05537308 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:59.268288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48f27-f41e-48f1-a00a-50a7799dc84e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:59.270005 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48f27-f41e-48f1-a00a-50a7799dc84e None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:59.278086 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 237/461] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:59.278086 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475bbf7-2140-4647-b182-bdf91052c32e None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:59.278086 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475bbf7-2140-4647-b182-bdf91052c32e None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:59.278086 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475bbf7-2140-4647-b182-bdf91052c32e None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:59.278086 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 238/462] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:59.283633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475bbf7-2140-4647-b182-bdf91052c32e None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-9fe48f27-f41e-48f1-a00a-50a7799dc84e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:58:59.290880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:59.291732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:59.292569 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:58:59.292569 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:58:59.292569 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:58:59.292569 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:58:59.297135 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 225/463] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:58:59.298201 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf7a3c-a62d-4442-9461-dc8b8d9b48e9 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:59.298493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf7a3c-a62d-4442-9461-dc8b8d9b48e9 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:59.298807 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf7a3c-a62d-4442-9461-dc8b8d9b48e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:59.319874 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-1cbf7a3c-a62d-4442-9461-dc8b8d9b48e9 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:59.321076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-1cbf7a3c-a62d-4442-9461-dc8b8d9b48e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:59.346224 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:59.390436 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 226/464] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:59.391309 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf7a3c-a62d-4442-9461-dc8b8d9b48e9 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:59.396259 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475bbf7-2140-4647-b182-bdf91052c32e None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:59.431760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddc00c-6f92-4c83-a53b-9b176498dfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:59.432374 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddc00c-6f92-4c83-a53b-9b176498dfb6 None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:59.432649 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddc00c-6f92-4c83-a53b-9b176498dfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:59.432919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddc00c-6f92-4c83-a53b-9b176498dfb6 None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:59.433582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddc00c-6f92-4c83-a53b-9b176498dfb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:59.435197 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddc00c-6f92-4c83-a53b-9b176498dfb6 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:59.469865 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 239/465] 10.222.0.65 () {60 vars in 1132 bytes} [Mon Jul 25 23:58:59 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:58:59.469865 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a030cb7-eaa6-458f-a130-38bc60c8cab6 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:59.469865 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a030cb7-eaa6-458f-a130-38bc60c8cab6 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:59.469865 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a030cb7-eaa6-458f-a130-38bc60c8cab6 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:59.469865 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 240/466] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:58:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:58:59.469865 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a030cb7-eaa6-458f-a130-38bc60c8cab6 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:59.515295 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf7a3c-a62d-4442-9461-dc8b8d9b48e9 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:59.530874 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:59.557597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1c5bc-20ef-4671-b8f9-2307b8ddf15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:59.558520 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1c5bc-20ef-4671-b8f9-2307b8ddf15d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:59.559541 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1c5bc-20ef-4671-b8f9-2307b8ddf15d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:59.560049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1c5bc-20ef-4671-b8f9-2307b8ddf15d None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:59.561430 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1c5bc-20ef-4671-b8f9-2307b8ddf15d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:59.561929 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1c5bc-20ef-4671-b8f9-2307b8ddf15d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:59.564211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1c5bc-20ef-4671-b8f9-2307b8ddf15d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:59.585548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a030cb7-eaa6-458f-a130-38bc60c8cab6 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:59.589594 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 227/467] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:59.591730 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac5061-c9d1-4bf5-b137-b10d120cc0e0 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:59.592198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac5061-c9d1-4bf5-b137-b10d120cc0e0 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:59.592604 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac5061-c9d1-4bf5-b137-b10d120cc0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:59.596688 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:59.619105 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-09ac5061-c9d1-4bf5-b137-b10d120cc0e0 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:58:59.620483 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-09ac5061-c9d1-4bf5-b137-b10d120cc0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:58:59.625881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74508dc1-b8b0-4bff-b772-c986f4d19a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:59.626527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74508dc1-b8b0-4bff-b772-c986f4d19a87 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:59.626861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74508dc1-b8b0-4bff-b772-c986f4d19a87 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:59.627141 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74508dc1-b8b0-4bff-b772-c986f4d19a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:59.641589 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74508dc1-b8b0-4bff-b772-c986f4d19a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:59.643124 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74508dc1-b8b0-4bff-b772-c986f4d19a87 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-74508dc1-b8b0-4bff-b772-c986f4d19a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:58:59.662106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:58:59.663104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:58:59.663957 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:58:59.663957 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:58:59.663957 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:58:59.663957 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:58:59.663957 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 241/468] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:58:59.664736 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74508dc1-b8b0-4bff-b772-c986f4d19a87 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:59.710513 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 228/469] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:58:59.711672 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac5061-c9d1-4bf5-b137-b10d120cc0e0 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:59.788588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74508dc1-b8b0-4bff-b772-c986f4d19a87 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:59.820252 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac5061-c9d1-4bf5-b137-b10d120cc0e0 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:58:59.822489 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:59.830331 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c00aa9-eb41-496c-96ea-61f2145bd9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:59.830985 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c00aa9-eb41-496c-96ea-61f2145bd9dd None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:59.831363 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c00aa9-eb41-496c-96ea-61f2145bd9dd None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:59.831805 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c00aa9-eb41-496c-96ea-61f2145bd9dd None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:59.832482 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c00aa9-eb41-496c-96ea-61f2145bd9dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:59.833909 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c00aa9-eb41-496c-96ea-61f2145bd9dd None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:59.856109 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 242/470] 10.222.0.65 () {60 vars in 1132 bytes} [Mon Jul 25 23:58:59 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:58:59.857537 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c00aa9-eb41-496c-96ea-61f2145bd9dd None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:58:59.869548 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2c240-7252-4402-8b63-9e22f74ca7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:58:59.870530 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2c240-7252-4402-8b63-9e22f74ca7cc None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:58:59.871108 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2c240-7252-4402-8b63-9e22f74ca7cc None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:58:59.871588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2c240-7252-4402-8b63-9e22f74ca7cc None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:58:59.873017 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2c240-7252-4402-8b63-9e22f74ca7cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:58:59.873475 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2c240-7252-4402-8b63-9e22f74ca7cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:58:59.875060 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2c240-7252-4402-8b63-9e22f74ca7cc None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:58:59.885404 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:58:59.895188 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 229/471] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:58:59.898209 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2c240-7252-4402-8b63-9e22f74ca7cc None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:00.030858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c00aa9-eb41-496c-96ea-61f2145bd9dd None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:00.042148 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2c240-7252-4402-8b63-9e22f74ca7cc None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:00.085308 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92100aab-67dd-4aed-a29d-ad228eddf805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:00.086306 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92100aab-67dd-4aed-a29d-ad228eddf805 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:00.086829 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92100aab-67dd-4aed-a29d-ad228eddf805 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:00.087299 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92100aab-67dd-4aed-a29d-ad228eddf805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:00.089616 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed76476-7f3a-4893-95f5-552955697385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:00.090250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed76476-7f3a-4893-95f5-552955697385 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:00.090531 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed76476-7f3a-4893-95f5-552955697385 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:00.092130 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed76476-7f3a-4893-95f5-552955697385 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:00.092130 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed76476-7f3a-4893-95f5-552955697385 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:00.093590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed76476-7f3a-4893-95f5-552955697385 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:00.101369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92100aab-67dd-4aed-a29d-ad228eddf805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:00.103090 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92100aab-67dd-4aed-a29d-ad228eddf805 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:00.122744 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 230/472] 10.222.0.65 () {60 vars in 1132 bytes} [Mon Jul 25 23:58:59 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-92100aab-67dd-4aed-a29d-ad228eddf805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:00.122961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:00.123718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:00.124708 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:00.124708 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:00.124708 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:00.124708 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:00.124708 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 243/473] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:00.130262 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed76476-7f3a-4893-95f5-552955697385 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:00.153623 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:00.255084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed76476-7f3a-4893-95f5-552955697385 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:00.293170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf813f55-8121-4758-97ed-4a7a55bcc18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:00.293839 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf813f55-8121-4758-97ed-4a7a55bcc18d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:00.294122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf813f55-8121-4758-97ed-4a7a55bcc18d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:00.294400 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf813f55-8121-4758-97ed-4a7a55bcc18d None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:00.295139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf813f55-8121-4758-97ed-4a7a55bcc18d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:00.295445 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf813f55-8121-4758-97ed-4a7a55bcc18d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:00.296938 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf813f55-8121-4758-97ed-4a7a55bcc18d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:00.311532 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 231/474] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:00.317099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92100aab-67dd-4aed-a29d-ad228eddf805 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:00.390505 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:00.427541 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92100aab-67dd-4aed-a29d-ad228eddf805 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:00.464490 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b055b1-8873-4ba1-b281-64f1ee1fc3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:00.465631 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b055b1-8873-4ba1-b281-64f1ee1fc3fe None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:00.466216 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b055b1-8873-4ba1-b281-64f1ee1fc3fe None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:00.466899 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b055b1-8873-4ba1-b281-64f1ee1fc3fe None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:00.467811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b055b1-8873-4ba1-b281-64f1ee1fc3fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:00.469563 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b055b1-8873-4ba1-b281-64f1ee1fc3fe None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:00.499022 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 244/475] 10.222.0.65 () {60 vars in 1132 bytes} [Mon Jul 25 23:59:00 2022] POST /identity/v3/users => generated 249 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:59:01.786693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76057d-7d96-4232-9e25-419e28b26f03 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:01.787251 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76057d-7d96-4232-9e25-419e28b26f03 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:01.787251 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76057d-7d96-4232-9e25-419e28b26f03 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:01.788817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 232/476] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:01.794485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd44b-09e9-46c9-897b-275640ca507e None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:01.794905 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd44b-09e9-46c9-897b-275640ca507e None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:01.795098 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd44b-09e9-46c9-897b-275640ca507e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:01.814394 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-801fd44b-09e9-46c9-897b-275640ca507e None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:01.815603 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-801fd44b-09e9-46c9-897b-275640ca507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:01.889153 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 245/477] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:01.912811 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76057d-7d96-4232-9e25-419e28b26f03 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:02.000208 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:02.025361 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76057d-7d96-4232-9e25-419e28b26f03 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:02.063056 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265644c3-fb5b-4667-baaf-2ed09a1920a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:02.064044 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265644c3-fb5b-4667-baaf-2ed09a1920a3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.064570 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265644c3-fb5b-4667-baaf-2ed09a1920a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.065055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265644c3-fb5b-4667-baaf-2ed09a1920a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.076991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265644c3-fb5b-4667-baaf-2ed09a1920a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-265644c3-fb5b-4667-baaf-2ed09a1920a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:02.082116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:02.083035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:02.083815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:02.083815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:02.083815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:02.083815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:02.083815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:02.083815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:02.083815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:02.083815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:02.083815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:02.083815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:02.083815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:02.083815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:02.086463 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 233/478] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:02.095562 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fd44b-09e9-46c9-897b-275640ca507e None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:02.153969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:02.203641 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fd44b-09e9-46c9-897b-275640ca507e None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:02.244631 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b670-d6ca-4e53-92d2-28d83db9ce3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:02.245691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b670-d6ca-4e53-92d2-28d83db9ce3f None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.246178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b670-d6ca-4e53-92d2-28d83db9ce3f None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.246654 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b670-d6ca-4e53-92d2-28d83db9ce3f None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.248343 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806b670-d6ca-4e53-92d2-28d83db9ce3f None admin] RBAC: Adding query filter params (name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:02.248866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806b670-d6ca-4e53-92d2-28d83db9ce3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:02.250501 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806b670-d6ca-4e53-92d2-28d83db9ce3f None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:02.260896 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 246/479] 10.222.0.65 () {56 vars in 1103 bytes} [Mon Jul 25 23:59:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:02.268036 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265644c3-fb5b-4667-baaf-2ed09a1920a3 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:02.380148 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265644c3-fb5b-4667-baaf-2ed09a1920a3 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:02.396292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbaffa-4eaf-4c39-b666-a267e31b2c82 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.396648 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbaffa-4eaf-4c39-b666-a267e31b2c82 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.396847 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbaffa-4eaf-4c39-b666-a267e31b2c82 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.399438 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 247/480] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:59:02.404268 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74dcd9-f59f-48e7-9c50-3bcbf77e58b0 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.404570 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74dcd9-f59f-48e7-9c50-3bcbf77e58b0 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.404824 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74dcd9-f59f-48e7-9c50-3bcbf77e58b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.424229 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5eef-0b81-42e5-a455-e6517dcef701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:02.424822 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-df74dcd9-f59f-48e7-9c50-3bcbf77e58b0 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:02.425490 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5eef-0b81-42e5-a455-e6517dcef701 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.425999 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5eef-0b81-42e5-a455-e6517dcef701 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.426126 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-df74dcd9-f59f-48e7-9c50-3bcbf77e58b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:02.426597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5eef-0b81-42e5-a455-e6517dcef701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.437944 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:02.448408 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5eef-0b81-42e5-a455-e6517dcef701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:02.451034 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5eef-0b81-42e5-a455-e6517dcef701 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-cb6e5eef-0b81-42e5-a455-e6517dcef701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:02.472032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:02.472911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:02.473768 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:02.473768 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:02.473768 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:02.473768 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:02.476201 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 234/481] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:02.481535 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5eef-0b81-42e5-a455-e6517dcef701 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:02.513397 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 248/482] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:02.537462 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74dcd9-f59f-48e7-9c50-3bcbf77e58b0 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:02.594207 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5eef-0b81-42e5-a455-e6517dcef701 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:02.594693 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:02.630977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03b548-d26a-4b66-a3ad-390e29feafef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:02.631521 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03b548-d26a-4b66-a3ad-390e29feafef None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.632186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03b548-d26a-4b66-a3ad-390e29feafef None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.632186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03b548-d26a-4b66-a3ad-390e29feafef None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.632751 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03b548-d26a-4b66-a3ad-390e29feafef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:02.633059 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03b548-d26a-4b66-a3ad-390e29feafef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:02.634491 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03b548-d26a-4b66-a3ad-390e29feafef None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:02.653578 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 235/483] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:02.653578 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49d324-000c-4bfc-bf85-684a6a3f781b None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.653578 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49d324-000c-4bfc-bf85-684a6a3f781b None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.653578 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49d324-000c-4bfc-bf85-684a6a3f781b None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.657876 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 236/484] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:02.659255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49d324-000c-4bfc-bf85-684a6a3f781b None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:02.659737 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74dcd9-f59f-48e7-9c50-3bcbf77e58b0 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:02.699559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827257e-2fc3-4408-a95c-f98ab889ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:02.700122 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827257e-2fc3-4408-a95c-f98ab889ddd6 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.700398 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827257e-2fc3-4408-a95c-f98ab889ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.700667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827257e-2fc3-4408-a95c-f98ab889ddd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.711517 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827257e-2fc3-4408-a95c-f98ab889ddd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:02.714896 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-4827257e-2fc3-4408-a95c-f98ab889ddd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:02.716373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:02.717263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:02.718057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:02.718057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:02.718057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:02.718057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:02.718057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:02.718057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:02.718057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:02.718057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:02.718057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:02.718057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:02.718057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:02.718057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:02.722526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 249/485] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:02.723740 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d1e0e-ceed-4a47-b542-2377ef4c9a9a None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.724027 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d1e0e-ceed-4a47-b542-2377ef4c9a9a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.724286 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d1e0e-ceed-4a47-b542-2377ef4c9a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.742821 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-3d8d1e0e-ceed-4a47-b542-2377ef4c9a9a None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:02.743983 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-3d8d1e0e-ceed-4a47-b542-2377ef4c9a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:02.769142 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49d324-000c-4bfc-bf85-684a6a3f781b None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:02.804550 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06321ab2-0194-4d43-b007-8602fe754fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:02.805177 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06321ab2-0194-4d43-b007-8602fe754fe0 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.805445 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06321ab2-0194-4d43-b007-8602fe754fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.805713 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06321ab2-0194-4d43-b007-8602fe754fe0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.813815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06321ab2-0194-4d43-b007-8602fe754fe0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:02.815357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06321ab2-0194-4d43-b007-8602fe754fe0 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:02.816544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 250/486] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:02.817371 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d1e0e-ceed-4a47-b542-2377ef4c9a9a None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-06321ab2-0194-4d43-b007-8602fe754fe0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:02.828603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:02.829559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:02.830454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:02.830454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:02.830454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:02.830454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:02.830454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:02.830454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:02.830454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:02.830454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:02.830454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:59:02.830454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:02.830454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 237/487] 10.222.0.65 () {56 vars in 1093 bytes} [Mon Jul 25 23:59:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:02.831050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe09d9-55e3-4ead-a7c5-3f4657e23987 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.831439 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe09d9-55e3-4ead-a7c5-3f4657e23987 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.831439 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe09d9-55e3-4ead-a7c5-3f4657e23987 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.834671 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 238/488] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:02.835529 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe09d9-55e3-4ead-a7c5-3f4657e23987 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:02.865185 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:02.928460 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d1e0e-ceed-4a47-b542-2377ef4c9a9a None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:02.941222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe09d9-55e3-4ead-a7c5-3f4657e23987 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:02.951733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:02.962215 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c232d3-802a-4448-9ab0-56afd49b9bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:02.963035 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c232d3-802a-4448-9ab0-56afd49b9bf1 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.963321 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c232d3-802a-4448-9ab0-56afd49b9bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.963608 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c232d3-802a-4448-9ab0-56afd49b9bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.964313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c232d3-802a-4448-9ab0-56afd49b9bf1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:02.964618 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c232d3-802a-4448-9ab0-56afd49b9bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:02.966146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c232d3-802a-4448-9ab0-56afd49b9bf1 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:02.975413 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 251/489] 10.222.0.65 () {56 vars in 1103 bytes} [Mon Jul 25 23:59:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:02.975569 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ea195-5bba-4b34-8177-72c4c4a03001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:02.976093 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ea195-5bba-4b34-8177-72c4c4a03001 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.976437 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ea195-5bba-4b34-8177-72c4c4a03001 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.976712 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ea195-5bba-4b34-8177-72c4c4a03001 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.977433 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe949c93-fd23-42ca-bd23-818e7fbf8091 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:02.977558 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ea195-5bba-4b34-8177-72c4c4a03001 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:02.977790 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ea195-5bba-4b34-8177-72c4c4a03001 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:02.978156 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe949c93-fd23-42ca-bd23-818e7fbf8091 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:02.978564 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe949c93-fd23-42ca-bd23-818e7fbf8091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:02.979281 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ea195-5bba-4b34-8177-72c4c4a03001 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:02.998566 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-fe949c93-fd23-42ca-bd23-818e7fbf8091 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:02.999781 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-fe949c93-fd23-42ca-bd23-818e7fbf8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:03.018091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 239/490] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Jul 25 23:59:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:03.018952 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ea195-5bba-4b34-8177-72c4c4a03001 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:03.070388 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 252/491] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:03.071269 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe949c93-fd23-42ca-bd23-818e7fbf8091 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:03.112232 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:03.118192 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ea195-5bba-4b34-8177-72c4c4a03001 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:03.152043 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45c022-3dfa-4c32-b54f-c67069ab52d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:03.152680 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45c022-3dfa-4c32-b54f-c67069ab52d1 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:03.152964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45c022-3dfa-4c32-b54f-c67069ab52d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:03.153241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45c022-3dfa-4c32-b54f-c67069ab52d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:03.164302 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45c022-3dfa-4c32-b54f-c67069ab52d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-0e45c022-3dfa-4c32-b54f-c67069ab52d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:03.169241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:03.170112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:03.170954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 240/492] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:03.171601 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45c022-3dfa-4c32-b54f-c67069ab52d1 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:03.191940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe949c93-fd23-42ca-bd23-818e7fbf8091 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:03.202272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:03.225885 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73157fe7-f764-49c9-9829-8140057d1c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:03.226526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73157fe7-f764-49c9-9829-8140057d1c15 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:03.226837 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73157fe7-f764-49c9-9829-8140057d1c15 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:03.227114 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73157fe7-f764-49c9-9829-8140057d1c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:03.237146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73157fe7-f764-49c9-9829-8140057d1c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:03.238596 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73157fe7-f764-49c9-9829-8140057d1c15 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-73157fe7-f764-49c9-9829-8140057d1c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:03.253846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:03.254819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:03.255640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:03.255640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:03.255640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:03.255640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:03.255640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 253/493] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:03.255927 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73157fe7-f764-49c9-9829-8140057d1c15 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:03.279095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45c022-3dfa-4c32-b54f-c67069ab52d1 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:03.313040 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320daad-0fdf-4c12-bc23-5c58ef96bb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:03.313967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320daad-0fdf-4c12-bc23-5c58ef96bb31 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:03.314248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320daad-0fdf-4c12-bc23-5c58ef96bb31 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:03.314522 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320daad-0fdf-4c12-bc23-5c58ef96bb31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:03.334844 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:03.354245 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73157fe7-f764-49c9-9829-8140057d1c15 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:03.381141 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320daad-0fdf-4c12-bc23-5c58ef96bb31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:03.382612 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320daad-0fdf-4c12-bc23-5c58ef96bb31 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:03.389472 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae222-be95-4b9d-b39c-c59d18025428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:03.390101 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae222-be95-4b9d-b39c-c59d18025428 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:03.390386 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae222-be95-4b9d-b39c-c59d18025428 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:03.390671 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ae222-be95-4b9d-b39c-c59d18025428 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:03.400815 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ae222-be95-4b9d-b39c-c59d18025428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-654ae222-be95-4b9d-b39c-c59d18025428 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:03.406247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:03.407193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:03.407979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 254/494] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:03.408903 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae222-be95-4b9d-b39c-c59d18025428 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:03.413100 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:03.485647 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 241/495] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:59:03.486399 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320daad-0fdf-4c12-bc23-5c58ef96bb31 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:03.517722 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ae222-be95-4b9d-b39c-c59d18025428 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:03.550976 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe66e3-bbe3-4dee-8a63-9b33b71f2406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:03.551583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe66e3-bbe3-4dee-8a63-9b33b71f2406 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:03.551860 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe66e3-bbe3-4dee-8a63-9b33b71f2406 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:03.552131 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe66e3-bbe3-4dee-8a63-9b33b71f2406 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:03.552830 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe66e3-bbe3-4dee-8a63-9b33b71f2406 None admin] RBAC: Adding query filter params (name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:03.553133 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe66e3-bbe3-4dee-8a63-9b33b71f2406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:03.554782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe66e3-bbe3-4dee-8a63-9b33b71f2406 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:03.563223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 255/496] 10.222.0.65 () {56 vars in 1103 bytes} [Mon Jul 25 23:59:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:03.564002 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe66e3-bbe3-4dee-8a63-9b33b71f2406 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:03.566554 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:03.586767 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320daad-0fdf-4c12-bc23-5c58ef96bb31 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:03.613055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:03.622291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf0297-0269-4a24-aca3-c2ccaae50d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:03.622948 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf0297-0269-4a24-aca3-c2ccaae50d39 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:03.623233 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf0297-0269-4a24-aca3-c2ccaae50d39 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:03.623510 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf0297-0269-4a24-aca3-c2ccaae50d39 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:03.624193 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf0297-0269-4a24-aca3-c2ccaae50d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:03.624499 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf0297-0269-4a24-aca3-c2ccaae50d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:03.625869 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf0297-0269-4a24-aca3-c2ccaae50d39 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:03.636882 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 242/497] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:03.637684 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf0297-0269-4a24-aca3-c2ccaae50d39 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:03.663382 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe66e3-bbe3-4dee-8a63-9b33b71f2406 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:03.697029 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e83574-45f0-4526-ab83-0fbab51cf04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:03.697639 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e83574-45f0-4526-ab83-0fbab51cf04f None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:03.697921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e83574-45f0-4526-ab83-0fbab51cf04f None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:03.698196 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e83574-45f0-4526-ab83-0fbab51cf04f None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:03.698919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e83574-45f0-4526-ab83-0fbab51cf04f None admin] RBAC: Adding query filter params (name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:03.699223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e83574-45f0-4526-ab83-0fbab51cf04f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:03.700765 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e83574-45f0-4526-ab83-0fbab51cf04f None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:03.708651 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 256/498] 10.222.0.65 () {56 vars in 1103 bytes} [Mon Jul 25 23:59:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:03.709430 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e83574-45f0-4526-ab83-0fbab51cf04f None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:03.737995 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf0297-0269-4a24-aca3-c2ccaae50d39 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:03.768722 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:03.771002 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae9d52-09eb-41ae-8d98-70c97ca12c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:03.771903 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae9d52-09eb-41ae-8d98-70c97ca12c15 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:03.772186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae9d52-09eb-41ae-8d98-70c97ca12c15 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:03.772463 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae9d52-09eb-41ae-8d98-70c97ca12c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:03.783512 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae9d52-09eb-41ae-8d98-70c97ca12c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:03.784978 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae9d52-09eb-41ae-8d98-70c97ca12c15 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-57ae9d52-09eb-41ae-8d98-70c97ca12c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:03.799547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:03.800568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:03.801503 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:03.801503 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:03.801503 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:03.801503 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:03.801503 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 243/499] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:03.801503 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae9d52-09eb-41ae-8d98-70c97ca12c15 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:03.813417 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e83574-45f0-4526-ab83-0fbab51cf04f None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:03.843406 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:03.847091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dc658-6060-4ead-b18f-30adb38659e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:03.847729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dc658-6060-4ead-b18f-30adb38659e5 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:03.848011 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dc658-6060-4ead-b18f-30adb38659e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:03.848288 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dc658-6060-4ead-b18f-30adb38659e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:03.860505 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dc658-6060-4ead-b18f-30adb38659e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:03.861956 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dc658-6060-4ead-b18f-30adb38659e5 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-b82dc658-6060-4ead-b18f-30adb38659e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:03.876588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:03.877585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:03.878611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:03.878611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:03.878611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:03.878611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:03.878611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 257/500] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:03.878611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dc658-6060-4ead-b18f-30adb38659e5 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:03.905996 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae9d52-09eb-41ae-8d98-70c97ca12c15 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:03.939182 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a7ee6-454b-46fe-b576-4157724accdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:03.939815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a7ee6-454b-46fe-b576-4157724accdd None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:03.940095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a7ee6-454b-46fe-b576-4157724accdd None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:03.940370 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a7ee6-454b-46fe-b576-4157724accdd None admin] PATH_INFO: `/v3/users/glance` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:03.948466 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a7ee6-454b-46fe-b576-4157724accdd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:03.950033 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a7ee6-454b-46fe-b576-4157724accdd None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-c40a7ee6-454b-46fe-b576-4157724accdd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:03.961184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:03.962254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:03.963264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:03.963264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:03.963264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:03.963264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:03.963264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:03.963264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:03.963264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:03.963264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:03.963264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 23:59:03.963264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:03.963264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 244/501] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:59:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:03.963264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a7ee6-454b-46fe-b576-4157724accdd None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:03.985233 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dc658-6060-4ead-b18f-30adb38659e5 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:04.001988 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:04.019936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2918d8-c488-4cfa-a057-24f0e794f2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:04.020572 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2918d8-c488-4cfa-a057-24f0e794f2c8 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:04.020899 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2918d8-c488-4cfa-a057-24f0e794f2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:04.021180 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2918d8-c488-4cfa-a057-24f0e794f2c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:04.032158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2918d8-c488-4cfa-a057-24f0e794f2c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:04.034245 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2918d8-c488-4cfa-a057-24f0e794f2c8 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-ee2918d8-c488-4cfa-a057-24f0e794f2c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:04.048213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:04.049050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:04.049903 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:04.049903 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:04.049903 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:04.049903 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:04.049903 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 258/502] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:04.050160 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2918d8-c488-4cfa-a057-24f0e794f2c8 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:04.064419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:04.067413 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a7ee6-454b-46fe-b576-4157724accdd None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:04.103404 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fd3e7-aff1-422a-9690-946b517b0674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:04.104118 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd3e7-aff1-422a-9690-946b517b0674 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:04.104407 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd3e7-aff1-422a-9690-946b517b0674 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:04.104685 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd3e7-aff1-422a-9690-946b517b0674 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:04.105364 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fd3e7-aff1-422a-9690-946b517b0674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:04.105671 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fd3e7-aff1-422a-9690-946b517b0674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:04.108198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fd3e7-aff1-422a-9690-946b517b0674 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:04.120197 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 245/503] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:04.120989 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fd3e7-aff1-422a-9690-946b517b0674 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:04.151211 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2918d8-c488-4cfa-a057-24f0e794f2c8 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:04.191794 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c103e4f-1c48-4e57-a989-729270fe4107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:04.192406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c103e4f-1c48-4e57-a989-729270fe4107 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:04.192686 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c103e4f-1c48-4e57-a989-729270fe4107 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:04.192965 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c103e4f-1c48-4e57-a989-729270fe4107 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:04.193642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c103e4f-1c48-4e57-a989-729270fe4107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:04.193948 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c103e4f-1c48-4e57-a989-729270fe4107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:04.195385 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c103e4f-1c48-4e57-a989-729270fe4107 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:04.207497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 259/504] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:04.208291 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c103e4f-1c48-4e57-a989-729270fe4107 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:04.226999 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fd3e7-aff1-422a-9690-946b517b0674 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:04.235493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:04.263079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658dc08-20c4-48c9-8d80-154421b1c4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:04.263618 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658dc08-20c4-48c9-8d80-154421b1c4f7 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:04.263904 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658dc08-20c4-48c9-8d80-154421b1c4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:04.264184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658dc08-20c4-48c9-8d80-154421b1c4f7 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:04.264969 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658dc08-20c4-48c9-8d80-154421b1c4f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:04.265277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658dc08-20c4-48c9-8d80-154421b1c4f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:04.266727 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658dc08-20c4-48c9-8d80-154421b1c4f7 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:04.283849 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 246/505] 10.222.0.65 () {56 vars in 1137 bytes} [Mon Jul 25 23:59:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:04.284663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658dc08-20c4-48c9-8d80-154421b1c4f7 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:04.304934 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:04.307755 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c103e4f-1c48-4e57-a989-729270fe4107 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:04.343045 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bcef1-bbe2-448d-945c-095290a933c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:04.343659 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bcef1-bbe2-448d-945c-095290a933c5 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:04.343931 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bcef1-bbe2-448d-945c-095290a933c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:04.344203 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bcef1-bbe2-448d-945c-095290a933c5 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:04.344884 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bcef1-bbe2-448d-945c-095290a933c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:04.345192 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bcef1-bbe2-448d-945c-095290a933c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:04.346551 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bcef1-bbe2-448d-945c-095290a933c5 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:04.357908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 260/506] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:04.358690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bcef1-bbe2-448d-945c-095290a933c5 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:04.390133 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658dc08-20c4-48c9-8d80-154421b1c4f7 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:04.424256 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874640fa-dd27-4c75-a381-38818173990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:04.424885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874640fa-dd27-4c75-a381-38818173990d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:04.425165 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874640fa-dd27-4c75-a381-38818173990d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:04.425436 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874640fa-dd27-4c75-a381-38818173990d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:04.432286 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874640fa-dd27-4c75-a381-38818173990d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:04.433723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874640fa-dd27-4c75-a381-38818173990d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-874640fa-dd27-4c75-a381-38818173990d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:04.446211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:04.447152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:04.447988 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:04.447988 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:04.447988 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:04.447988 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:04.447988 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:04.447988 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:04.447988 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:04.447988 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:04.447988 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 247/507] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:04.448449 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874640fa-dd27-4c75-a381-38818173990d None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:04.456763 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:04.470547 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bcef1-bbe2-448d-945c-095290a933c5 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:04.504044 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb820239-7199-4879-96a2-2fcb4de62bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:04.504682 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb820239-7199-4879-96a2-2fcb4de62bcb None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:04.504965 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb820239-7199-4879-96a2-2fcb4de62bcb None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:04.505245 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb820239-7199-4879-96a2-2fcb4de62bcb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:04.512921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb820239-7199-4879-96a2-2fcb4de62bcb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:04.514432 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb820239-7199-4879-96a2-2fcb4de62bcb None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:04.524232 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-fb820239-7199-4879-96a2-2fcb4de62bcb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:04.526640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:04.527577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:04.528943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:04.528943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:04.528943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:04.528943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:04.528943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:04.528943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:04.528943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:04.528943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:04.528943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:59:04.528943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:04.528943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 261/508] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:59:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:04.529675 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb820239-7199-4879-96a2-2fcb4de62bcb None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:04.550352 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874640fa-dd27-4c75-a381-38818173990d None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:04.585379 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e5f08-2e63-40f4-8732-822983402c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:04.586077 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e5f08-2e63-40f4-8732-822983402c69 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:04.586359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e5f08-2e63-40f4-8732-822983402c69 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:04.586632 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e5f08-2e63-40f4-8732-822983402c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:04.629606 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb820239-7199-4879-96a2-2fcb4de62bcb None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:04.655021 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e5f08-2e63-40f4-8732-822983402c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:04.656502 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e5f08-2e63-40f4-8732-822983402c69 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:04.662631 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649801e-64d2-4f5b-9053-2e85c544d0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:04.663287 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649801e-64d2-4f5b-9053-2e85c544d0be None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:04.663564 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649801e-64d2-4f5b-9053-2e85c544d0be None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:04.663837 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649801e-64d2-4f5b-9053-2e85c544d0be None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:04.672002 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649801e-64d2-4f5b-9053-2e85c544d0be None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:04.673438 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649801e-64d2-4f5b-9053-2e85c544d0be None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-c649801e-64d2-4f5b-9053-2e85c544d0be None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:04.685313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:04.686391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:04.687620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:04.687620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:04.687620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:04.687620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:04.687620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:04.687620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:04.687620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:04.687620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:04.687620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 23:59:04.687620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:04.690906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 262/509] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:04.691714 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649801e-64d2-4f5b-9053-2e85c544d0be None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:04.702892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:04.733508 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:04.755647 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 248/510] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:59:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:59:04.756460 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e5f08-2e63-40f4-8732-822983402c69 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:04.791605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649801e-64d2-4f5b-9053-2e85c544d0be None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:04.825619 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31543c-5ac8-4d86-9e79-bc554b86f815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:04.826226 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31543c-5ac8-4d86-9e79-bc554b86f815 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:04.826515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31543c-5ac8-4d86-9e79-bc554b86f815 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:04.826812 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31543c-5ac8-4d86-9e79-bc554b86f815 None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:04.827537 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31543c-5ac8-4d86-9e79-bc554b86f815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:04.827838 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31543c-5ac8-4d86-9e79-bc554b86f815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:04.829250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31543c-5ac8-4d86-9e79-bc554b86f815 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:04.846238 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 263/511] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:04.847061 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31543c-5ac8-4d86-9e79-bc554b86f815 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:04.855457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e5f08-2e63-40f4-8732-822983402c69 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:04.890233 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f821d01-d6b5-443e-8dce-9b7c3b8d2d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:04.890881 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f821d01-d6b5-443e-8dce-9b7c3b8d2d2d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:04.891161 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f821d01-d6b5-443e-8dce-9b7c3b8d2d2d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:04.891434 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f821d01-d6b5-443e-8dce-9b7c3b8d2d2d None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:04.892215 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f821d01-d6b5-443e-8dce-9b7c3b8d2d2d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:04.892520 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f821d01-d6b5-443e-8dce-9b7c3b8d2d2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:04.894052 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f821d01-d6b5-443e-8dce-9b7c3b8d2d2d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:04.910997 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 249/512] 10.222.0.65 () {56 vars in 1137 bytes} [Mon Jul 25 23:59:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:04.911790 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f821d01-d6b5-443e-8dce-9b7c3b8d2d2d None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:04.913151 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:04.946317 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:04.947966 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31543c-5ac8-4d86-9e79-bc554b86f815 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:04.985404 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be264a-1a0b-4144-9191-9de659143d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:04.986030 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be264a-1a0b-4144-9191-9de659143d16 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:04.986312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be264a-1a0b-4144-9191-9de659143d16 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:04.986587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be264a-1a0b-4144-9191-9de659143d16 None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:04.987408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be264a-1a0b-4144-9191-9de659143d16 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:04.987718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be264a-1a0b-4144-9191-9de659143d16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:04.989162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be264a-1a0b-4144-9191-9de659143d16 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:05.013826 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f821d01-d6b5-443e-8dce-9b7c3b8d2d2d None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:05.025558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 264/513] 10.222.0.65 () {56 vars in 1139 bytes} [Mon Jul 25 23:59:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:05.026365 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be264a-1a0b-4144-9191-9de659143d16 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:05.048075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568cf49-fadb-41ed-a528-f14dee0e2cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:05.048625 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568cf49-fadb-41ed-a528-f14dee0e2cd3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:05.048907 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568cf49-fadb-41ed-a528-f14dee0e2cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:05.049187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568cf49-fadb-41ed-a528-f14dee0e2cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:05.060295 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568cf49-fadb-41ed-a528-f14dee0e2cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:05.061839 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568cf49-fadb-41ed-a528-f14dee0e2cd3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-2568cf49-fadb-41ed-a528-f14dee0e2cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:05.076652 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:05.077668 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:05.078513 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:05.078513 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:05.078513 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:05.078513 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:05.078513 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 250/514] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:05.078819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568cf49-fadb-41ed-a528-f14dee0e2cd3 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:05.125459 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be264a-1a0b-4144-9191-9de659143d16 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:05.150096 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:05.160098 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a66a0-11a3-44ff-a047-15b8d49a98ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:05.160702 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a66a0-11a3-44ff-a047-15b8d49a98ac None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:05.160983 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a66a0-11a3-44ff-a047-15b8d49a98ac None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:05.161275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a66a0-11a3-44ff-a047-15b8d49a98ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:05.162011 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a66a0-11a3-44ff-a047-15b8d49a98ac None admin] RBAC: Adding query filter params (role.id=6be878a30a464fc38706d4cab9d64f17, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=a513753b2f49408baf24402f1fa3c7e9) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:05.162313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a66a0-11a3-44ff-a047-15b8d49a98ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:05.163827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a66a0-11a3-44ff-a047-15b8d49a98ac None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:05.169524 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:05.170691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 265/515] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:59:05 2022] GET /identity/v3/role_assignments?user.id=a513753b2f49408baf24402f1fa3c7e9&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=6be878a30a464fc38706d4cab9d64f17 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:05.171696 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a66a0-11a3-44ff-a047-15b8d49a98ac None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:05.195005 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568cf49-fadb-41ed-a528-f14dee0e2cd3 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:05.235124 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4570e88-a5ab-4705-8e5d-41e87c986c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:05.235767 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4570e88-a5ab-4705-8e5d-41e87c986c6f None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:05.236046 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4570e88-a5ab-4705-8e5d-41e87c986c6f None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:05.236317 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4570e88-a5ab-4705-8e5d-41e87c986c6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:05.299582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a66a0-11a3-44ff-a047-15b8d49a98ac None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:05.313005 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4570e88-a5ab-4705-8e5d-41e87c986c6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:05.314526 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4570e88-a5ab-4705-8e5d-41e87c986c6f None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:05.338753 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43094cd8-e489-4e35-9692-9e8e68e35a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:05.339397 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43094cd8-e489-4e35-9692-9e8e68e35a38 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:05.340845 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43094cd8-e489-4e35-9692-9e8e68e35a38 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:05.341161 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43094cd8-e489-4e35-9692-9e8e68e35a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:05.405630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:05.412991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:05.417480 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43094cd8-e489-4e35-9692-9e8e68e35a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:05.419584 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43094cd8-e489-4e35-9692-9e8e68e35a38 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:05.428240 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 251/516] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:59:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:59:05.429594 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4570e88-a5ab-4705-8e5d-41e87c986c6f None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:05.525960 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 266/517] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:59:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:59:05.526871 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43094cd8-e489-4e35-9692-9e8e68e35a38 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:05.538949 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4570e88-a5ab-4705-8e5d-41e87c986c6f None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:05.575412 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353c783-d960-4bef-8468-4c6bdffcea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:05.576072 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353c783-d960-4bef-8468-4c6bdffcea65 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:05.576350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353c783-d960-4bef-8468-4c6bdffcea65 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:05.576627 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353c783-d960-4bef-8468-4c6bdffcea65 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:05.577463 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353c783-d960-4bef-8468-4c6bdffcea65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:05.578056 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353c783-d960-4bef-8468-4c6bdffcea65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:05.579480 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353c783-d960-4bef-8468-4c6bdffcea65 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:05.598438 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 252/518] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:05.598438 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353c783-d960-4bef-8468-4c6bdffcea65 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:05.624660 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:05.637021 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43094cd8-e489-4e35-9692-9e8e68e35a38 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:05.648064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:05.677517 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fd22e-fda7-41da-bb42-2d3adb5838cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:05.678346 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fd22e-fda7-41da-bb42-2d3adb5838cc None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:05.678688 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fd22e-fda7-41da-bb42-2d3adb5838cc None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:05.679323 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fd22e-fda7-41da-bb42-2d3adb5838cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:05.690953 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fd22e-fda7-41da-bb42-2d3adb5838cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:05.692597 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fd22e-fda7-41da-bb42-2d3adb5838cc None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:05.701063 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353c783-d960-4bef-8468-4c6bdffcea65 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-b26fd22e-fda7-41da-bb42-2d3adb5838cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:05.708146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:05.708995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:05.709835 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:05.709835 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:05.709835 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:05.709835 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:05.713794 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 267/519] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:05.714576 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fd22e-fda7-41da-bb42-2d3adb5838cc None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:05.737272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089cd3d-c54a-4f90-8772-d0bed3a62948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:05.737909 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089cd3d-c54a-4f90-8772-d0bed3a62948 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:05.738191 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089cd3d-c54a-4f90-8772-d0bed3a62948 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:05.738465 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089cd3d-c54a-4f90-8772-d0bed3a62948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:05.749943 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089cd3d-c54a-4f90-8772-d0bed3a62948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:05.751443 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089cd3d-c54a-4f90-8772-d0bed3a62948 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-4089cd3d-c54a-4f90-8772-d0bed3a62948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:05.765186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:05.766054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:05.766891 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:05.766891 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:05.766891 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:05.766891 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:05.766891 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 253/520] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:05.767176 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089cd3d-c54a-4f90-8772-d0bed3a62948 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:05.822164 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fd22e-fda7-41da-bb42-2d3adb5838cc None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:05.858881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed27b1-be58-4933-b697-9fea018c241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:05.859787 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed27b1-be58-4933-b697-9fea018c241b None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:05.860370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed27b1-be58-4933-b697-9fea018c241b None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:05.860653 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed27b1-be58-4933-b697-9fea018c241b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:05.868562 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed27b1-be58-4933-b697-9fea018c241b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:05.869841 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:05.871555 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed27b1-be58-4933-b697-9fea018c241b None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:05.873516 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089cd3d-c54a-4f90-8772-d0bed3a62948 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-06ed27b1-be58-4933-b697-9fea018c241b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:05.886337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:05.887581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:05.888630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:05.888630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:05.888630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:05.888630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:05.888630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:05.888630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:05.888630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:05.888630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:05.893155 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 268/521] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:05.893821 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed27b1-be58-4933-b697-9fea018c241b None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:05.896674 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:05.911770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662f023-850b-45d4-8c0b-1022dfc420b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:05.912472 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662f023-850b-45d4-8c0b-1022dfc420b8 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:05.912817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662f023-850b-45d4-8c0b-1022dfc420b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:05.913159 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662f023-850b-45d4-8c0b-1022dfc420b8 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:05.913921 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662f023-850b-45d4-8c0b-1022dfc420b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:05.914281 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662f023-850b-45d4-8c0b-1022dfc420b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:05.915788 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662f023-850b-45d4-8c0b-1022dfc420b8 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:05.933323 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 254/522] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:05.933323 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662f023-850b-45d4-8c0b-1022dfc420b8 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:06.014694 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed27b1-be58-4933-b697-9fea018c241b None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:06.037579 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662f023-850b-45d4-8c0b-1022dfc420b8 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:06.048655 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf5961-c9d0-4a0d-b623-67fc7be1c7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:06.049263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf5961-c9d0-4a0d-b623-67fc7be1c7ff None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:06.049546 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf5961-c9d0-4a0d-b623-67fc7be1c7ff None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:06.049817 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf5961-c9d0-4a0d-b623-67fc7be1c7ff None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:06.050490 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf5961-c9d0-4a0d-b623-67fc7be1c7ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:06.050820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf5961-c9d0-4a0d-b623-67fc7be1c7ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:06.052189 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf5961-c9d0-4a0d-b623-67fc7be1c7ff None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:06.065151 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 269/523] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:06.065798 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf5961-c9d0-4a0d-b623-67fc7be1c7ff None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:06.083870 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9803a79-2e39-4e51-bb9f-188dde850a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:06.084594 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9803a79-2e39-4e51-bb9f-188dde850a47 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:06.084871 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9803a79-2e39-4e51-bb9f-188dde850a47 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:06.085140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9803a79-2e39-4e51-bb9f-188dde850a47 None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:06.085869 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9803a79-2e39-4e51-bb9f-188dde850a47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:06.086173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9803a79-2e39-4e51-bb9f-188dde850a47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:06.087738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9803a79-2e39-4e51-bb9f-188dde850a47 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:06.113006 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 255/524] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:06.113006 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9803a79-2e39-4e51-bb9f-188dde850a47 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:06.135577 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:06.144780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:06.192171 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf5961-c9d0-4a0d-b623-67fc7be1c7ff None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:06.221427 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9803a79-2e39-4e51-bb9f-188dde850a47 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:06.233525 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793f696-36e8-422b-ac88-355edaa86091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:06.234430 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793f696-36e8-422b-ac88-355edaa86091 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:06.234735 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793f696-36e8-422b-ac88-355edaa86091 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:06.235016 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793f696-36e8-422b-ac88-355edaa86091 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:06.244264 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793f696-36e8-422b-ac88-355edaa86091 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:06.247214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793f696-36e8-422b-ac88-355edaa86091 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:06.257382 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90873de9-7bed-4c64-9957-7a27fb78ee73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:06.258024 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90873de9-7bed-4c64-9957-7a27fb78ee73 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:06.258308 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90873de9-7bed-4c64-9957-7a27fb78ee73 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:06.258585 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90873de9-7bed-4c64-9957-7a27fb78ee73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-5793f696-36e8-422b-ac88-355edaa86091 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:06.260955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:06.261910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:06.263390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:06.263390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:06.263390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:06.263390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:06.263390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:06.263390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:06.263390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:06.263390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:06.263390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 270/525] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:06.263841 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793f696-36e8-422b-ac88-355edaa86091 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:06.268625 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90873de9-7bed-4c64-9957-7a27fb78ee73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:06.271029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90873de9-7bed-4c64-9957-7a27fb78ee73 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-90873de9-7bed-4c64-9957-7a27fb78ee73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:06.283039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:06.283894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:06.284723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:06.284723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:06.284723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:06.284723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:06.284723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:06.284723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:06.284723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:06.284723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:06.284723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 256/526] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:06.285263 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90873de9-7bed-4c64-9957-7a27fb78ee73 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:06.375656 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:06.379152 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793f696-36e8-422b-ac88-355edaa86091 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:06.398050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90873de9-7bed-4c64-9957-7a27fb78ee73 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:06.406690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:06.420403 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebc5c1-69fa-4855-af1c-1378eb81a1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:06.421018 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebc5c1-69fa-4855-af1c-1378eb81a1b8 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:06.421304 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebc5c1-69fa-4855-af1c-1378eb81a1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:06.421582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebc5c1-69fa-4855-af1c-1378eb81a1b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:06.422363 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebc5c1-69fa-4855-af1c-1378eb81a1b8 None admin] RBAC: Adding query filter params (role.id=6be878a30a464fc38706d4cab9d64f17, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=cbc09289c7e645b189776f109b78968e) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:06.422675 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebc5c1-69fa-4855-af1c-1378eb81a1b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:06.424143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebc5c1-69fa-4855-af1c-1378eb81a1b8 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:06.430093 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 271/527] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:59:06 2022] GET /identity/v3/role_assignments?user.id=cbc09289c7e645b189776f109b78968e&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=6be878a30a464fc38706d4cab9d64f17 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:06.430727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebc5c1-69fa-4855-af1c-1378eb81a1b8 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:06.445736 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358a627-b1b0-4414-b88b-67dddbb713e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:06.447059 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358a627-b1b0-4414-b88b-67dddbb713e2 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:06.448172 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358a627-b1b0-4414-b88b-67dddbb713e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:06.448851 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358a627-b1b0-4414-b88b-67dddbb713e2 None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:06.450468 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358a627-b1b0-4414-b88b-67dddbb713e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:06.450997 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358a627-b1b0-4414-b88b-67dddbb713e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:06.453486 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358a627-b1b0-4414-b88b-67dddbb713e2 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:06.474192 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 257/528] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:06.483141 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358a627-b1b0-4414-b88b-67dddbb713e2 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:06.553709 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebc5c1-69fa-4855-af1c-1378eb81a1b8 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:06.593486 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8145df-8848-4ba2-88f5-710d98818a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:06.594126 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8145df-8848-4ba2-88f5-710d98818a5c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:06.594408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8145df-8848-4ba2-88f5-710d98818a5c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:06.594691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8145df-8848-4ba2-88f5-710d98818a5c None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:06.595474 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8145df-8848-4ba2-88f5-710d98818a5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:06.595784 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8145df-8848-4ba2-88f5-710d98818a5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:06.597336 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8145df-8848-4ba2-88f5-710d98818a5c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:06.612016 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 272/529] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:06.619207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8145df-8848-4ba2-88f5-710d98818a5c None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:06.635420 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358a627-b1b0-4414-b88b-67dddbb713e2 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:06.671959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49764d07-12e1-482d-8e83-cd082fdaa8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:06.672576 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49764d07-12e1-482d-8e83-cd082fdaa8f3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:06.672867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49764d07-12e1-482d-8e83-cd082fdaa8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:06.673188 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49764d07-12e1-482d-8e83-cd082fdaa8f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:06.673971 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49764d07-12e1-482d-8e83-cd082fdaa8f3 None admin] RBAC: Adding query filter params (role.id=6be878a30a464fc38706d4cab9d64f17, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=5f8a981708a34de5be7cda18eb8bb1a3) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:06.674589 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49764d07-12e1-482d-8e83-cd082fdaa8f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:06.675918 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49764d07-12e1-482d-8e83-cd082fdaa8f3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:06.681050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:06.687053 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 258/530] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:59:06 2022] GET /identity/v3/role_assignments?user.id=5f8a981708a34de5be7cda18eb8bb1a3&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=6be878a30a464fc38706d4cab9d64f17 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:06.743452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8145df-8848-4ba2-88f5-710d98818a5c None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:06.784586 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505900bf-fb11-4177-a9c6-82b371d5e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:06.785593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505900bf-fb11-4177-a9c6-82b371d5e15c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:06.786112 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505900bf-fb11-4177-a9c6-82b371d5e15c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:06.786599 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505900bf-fb11-4177-a9c6-82b371d5e15c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:06.787664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505900bf-fb11-4177-a9c6-82b371d5e15c None admin] RBAC: Adding query filter params (role.id=6be878a30a464fc38706d4cab9d64f17, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=d4e34b7f817f452faabd2d32d1af3ab8) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:06.788212 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505900bf-fb11-4177-a9c6-82b371d5e15c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:06.789899 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505900bf-fb11-4177-a9c6-82b371d5e15c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:06.797037 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 273/531] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:59:06 2022] GET /identity/v3/role_assignments?user.id=d4e34b7f817f452faabd2d32d1af3ab8&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=6be878a30a464fc38706d4cab9d64f17 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:07.464998 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e06f2-b51a-430e-9053-f0386f6eb344 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:07.465618 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e06f2-b51a-430e-9053-f0386f6eb344 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:07.465802 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e06f2-b51a-430e-9053-f0386f6eb344 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:07.467199 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 259/532] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:07.473277 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c546-2a9f-4204-acde-66c29706503b None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:07.473677 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c546-2a9f-4204-acde-66c29706503b None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:07.473846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c546-2a9f-4204-acde-66c29706503b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:07.493271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-ea29c546-2a9f-4204-acde-66c29706503b None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:07.494433 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-ea29c546-2a9f-4204-acde-66c29706503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:07.565963 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 274/533] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:59:07.585598 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e06f2-b51a-430e-9053-f0386f6eb344 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:07.589507 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:07.691154 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e06f2-b51a-430e-9053-f0386f6eb344 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:07.725016 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e5525-d6e4-44ca-bbff-579c986ff19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:07.725572 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5525-d6e4-44ca-bbff-579c986ff19d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:07.725849 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5525-d6e4-44ca-bbff-579c986ff19d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:07.726119 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5525-d6e4-44ca-bbff-579c986ff19d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:07.736699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e5525-d6e4-44ca-bbff-579c986ff19d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-d93e5525-d6e4-44ca-bbff-579c986ff19d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:07.741501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:07.742380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:07.743211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:07.743211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:07.743211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:07.743211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:07.743211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:07.743211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:07.743211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:07.743211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:07.743211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:07.743211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:07.743211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:07.743211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:07.747051 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 260/534] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:07.749368 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29c546-2a9f-4204-acde-66c29706503b None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:07.790435 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:07.852710 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29c546-2a9f-4204-acde-66c29706503b None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:07.889437 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaff9d9-7b76-4131-a7dc-c83dbcc3594b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:07.890422 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaff9d9-7b76-4131-a7dc-c83dbcc3594b None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:07.891003 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaff9d9-7b76-4131-a7dc-c83dbcc3594b None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:07.891484 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaff9d9-7b76-4131-a7dc-c83dbcc3594b None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:07.892387 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaff9d9-7b76-4131-a7dc-c83dbcc3594b None admin] RBAC: Adding query filter params (name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:07.892925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaff9d9-7b76-4131-a7dc-c83dbcc3594b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:07.894506 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaff9d9-7b76-4131-a7dc-c83dbcc3594b None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:07.903676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 275/535] 10.222.0.65 () {56 vars in 1103 bytes} [Mon Jul 25 23:59:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:07.911932 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e5525-d6e4-44ca-bbff-579c986ff19d None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:07.980513 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:08.025276 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e5525-d6e4-44ca-bbff-579c986ff19d None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:08.065037 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d376d-2d9e-4d2b-b9be-481eae7ffa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:08.065919 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d376d-2d9e-4d2b-b9be-481eae7ffa3f None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:08.066350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d376d-2d9e-4d2b-b9be-481eae7ffa3f None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:08.066801 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d376d-2d9e-4d2b-b9be-481eae7ffa3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:08.079278 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d376d-2d9e-4d2b-b9be-481eae7ffa3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:08.081057 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d376d-2d9e-4d2b-b9be-481eae7ffa3f None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-3d0d376d-2d9e-4d2b-b9be-481eae7ffa3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:08.097770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:08.098892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:08.099965 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:08.099965 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:08.099965 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:08.099965 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:08.101777 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 261/536] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:08.111310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaff9d9-7b76-4131-a7dc-c83dbcc3594b None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:08.214818 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaff9d9-7b76-4131-a7dc-c83dbcc3594b None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:08.216881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:08.256311 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f463f5-efb9-4a98-ab2b-225dd13209d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:08.257186 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f463f5-efb9-4a98-ab2b-225dd13209d8 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:08.257600 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f463f5-efb9-4a98-ab2b-225dd13209d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:08.258003 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f463f5-efb9-4a98-ab2b-225dd13209d8 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:08.258877 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f463f5-efb9-4a98-ab2b-225dd13209d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:08.259329 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f463f5-efb9-4a98-ab2b-225dd13209d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:08.260847 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f463f5-efb9-4a98-ab2b-225dd13209d8 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:08.274462 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 276/537] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:08.281207 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d376d-2d9e-4d2b-b9be-481eae7ffa3f None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:08.390284 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d376d-2d9e-4d2b-b9be-481eae7ffa3f None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:08.419304 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:08.426989 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11f742-30c2-4551-abca-0f41e504ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:08.427857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11f742-30c2-4551-abca-0f41e504ea3b None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:08.428289 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11f742-30c2-4551-abca-0f41e504ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:08.428711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11f742-30c2-4551-abca-0f41e504ea3b None admin] PATH_INFO: `/v3/users/nova` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:08.438051 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11f742-30c2-4551-abca-0f41e504ea3b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:08.439720 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11f742-30c2-4551-abca-0f41e504ea3b None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-cf11f742-30c2-4551-abca-0f41e504ea3b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:08.451817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:08.452931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:08.454055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:08.454055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:08.454055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:08.454055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:08.454055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:08.454055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:08.454055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:08.454055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:08.454055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:59:08.454055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:08.456319 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 262/538] 10.222.0.65 () {56 vars in 1093 bytes} [Mon Jul 25 23:59:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:08.463870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f463f5-efb9-4a98-ab2b-225dd13209d8 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:08.574055 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f463f5-efb9-4a98-ab2b-225dd13209d8 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:08.620004 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe9366-83b4-4a02-a061-a18929998491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:08.626738 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe9366-83b4-4a02-a061-a18929998491 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:08.626738 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe9366-83b4-4a02-a061-a18929998491 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:08.626738 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe9366-83b4-4a02-a061-a18929998491 None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:08.626738 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe9366-83b4-4a02-a061-a18929998491 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:08.626738 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe9366-83b4-4a02-a061-a18929998491 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:08.626738 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe9366-83b4-4a02-a061-a18929998491 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:08.642865 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 277/539] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Jul 25 23:59:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:08.648299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11f742-30c2-4551-abca-0f41e504ea3b None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:08.756601 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11f742-30c2-4551-abca-0f41e504ea3b None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:08.777288 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33998ee4-a638-4c8e-a637-5f27f7eefba2 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:08.777642 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33998ee4-a638-4c8e-a637-5f27f7eefba2 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:08.778687 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33998ee4-a638-4c8e-a637-5f27f7eefba2 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:08.782819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 278/540] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:08.786078 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310658f-42df-440e-84ec-491ad5f0998c None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:08.786359 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310658f-42df-440e-84ec-491ad5f0998c None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:08.786695 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310658f-42df-440e-84ec-491ad5f0998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:08.803641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253c820-57a5-413b-a6bc-bc237d65ccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:08.804695 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c820-57a5-413b-a6bc-bc237d65ccb6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:08.804983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c820-57a5-413b-a6bc-bc237d65ccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:08.805251 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c820-57a5-413b-a6bc-bc237d65ccb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:08.807068 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-7310658f-42df-440e-84ec-491ad5f0998c None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:08.809568 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-7310658f-42df-440e-84ec-491ad5f0998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:08.819997 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253c820-57a5-413b-a6bc-bc237d65ccb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:08.822270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253c820-57a5-413b-a6bc-bc237d65ccb6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:08.831182 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-4253c820-57a5-413b-a6bc-bc237d65ccb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:08.847190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:08.848291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:08.849258 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:08.849258 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:08.849258 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:08.849258 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:08.849258 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 263/541] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:08.854909 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253c820-57a5-413b-a6bc-bc237d65ccb6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:08.890200 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:08.906872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 279/542] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:08.935080 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310658f-42df-440e-84ec-491ad5f0998c None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:08.980606 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253c820-57a5-413b-a6bc-bc237d65ccb6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:09.017853 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc5dc6-ae97-4edd-92bd-11f72fefd331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:09.018474 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc5dc6-ae97-4edd-92bd-11f72fefd331 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.018787 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc5dc6-ae97-4edd-92bd-11f72fefd331 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.019071 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc5dc6-ae97-4edd-92bd-11f72fefd331 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.019760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc5dc6-ae97-4edd-92bd-11f72fefd331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:09.020068 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc5dc6-ae97-4edd-92bd-11f72fefd331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:09.021469 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc5dc6-ae97-4edd-92bd-11f72fefd331 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:09.034477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 264/543] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:09.035584 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a200a-f43a-4aa3-a8ed-14956a5206bd None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.035874 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a200a-f43a-4aa3-a8ed-14956a5206bd None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.036154 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a200a-f43a-4aa3-a8ed-14956a5206bd None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.037612 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 265/544] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:09.040013 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a200a-f43a-4aa3-a8ed-14956a5206bd None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:09.048092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310658f-42df-440e-84ec-491ad5f0998c None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:09.086539 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f7655-16a3-4984-8a1c-c501c6d7c1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:09.087515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f7655-16a3-4984-8a1c-c501c6d7c1a0 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.087941 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f7655-16a3-4984-8a1c-c501c6d7c1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.088419 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f7655-16a3-4984-8a1c-c501c6d7c1a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.100406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f7655-16a3-4984-8a1c-c501c6d7c1a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-ed3f7655-16a3-4984-8a1c-c501c6d7c1a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:09.106991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:09.108162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:09.109149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:09.109149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:09.109149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:09.109149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:09.109149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:09.109149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:09.109149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:09.109149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:09.109149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:09.109149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:09.109149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:09.109149 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:09.111336 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 280/545] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:59:09.112915 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f2494-c7c5-4a39-8562-5eb25ac4de9e None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.113199 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f2494-c7c5-4a39-8562-5eb25ac4de9e None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.113593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f2494-c7c5-4a39-8562-5eb25ac4de9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.132249 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-a82f2494-c7c5-4a39-8562-5eb25ac4de9e None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:09.133718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-a82f2494-c7c5-4a39-8562-5eb25ac4de9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:09.136731 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:09.138228 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:09.154025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a200a-f43a-4aa3-a8ed-14956a5206bd None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:09.194548 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a965c87-0a97-4589-9743-9f54074b3e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:09.195221 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a965c87-0a97-4589-9743-9f54074b3e9c None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.195499 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a965c87-0a97-4589-9743-9f54074b3e9c None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.195777 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a965c87-0a97-4589-9743-9f54074b3e9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.202597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a965c87-0a97-4589-9743-9f54074b3e9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:09.204093 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a965c87-0a97-4589-9743-9f54074b3e9c None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:09.213203 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 281/546] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:09.214348 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f2494-c7c5-4a39-8562-5eb25ac4de9e None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-4a965c87-0a97-4589-9743-9f54074b3e9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:09.215847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:09.216663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:09.219340 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:09.219340 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:09.219340 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:09.219340 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:09.219340 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:09.219340 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:09.219340 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:09.219340 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:09.219340 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 266/547] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:09.222586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a965c87-0a97-4589-9743-9f54074b3e9c None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:09.330998 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f2494-c7c5-4a39-8562-5eb25ac4de9e None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:09.332872 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a965c87-0a97-4589-9743-9f54074b3e9c None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:09.365655 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968ad31-64b3-461e-aec5-615d51dfddb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:09.366200 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968ad31-64b3-461e-aec5-615d51dfddb9 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.366484 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968ad31-64b3-461e-aec5-615d51dfddb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.366794 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968ad31-64b3-461e-aec5-615d51dfddb9 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.367500 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968ad31-64b3-461e-aec5-615d51dfddb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:09.367809 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968ad31-64b3-461e-aec5-615d51dfddb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:09.367919 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22242a-38ce-4258-867b-7dc7f9df3a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:09.368524 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22242a-38ce-4258-867b-7dc7f9df3a4d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.368812 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22242a-38ce-4258-867b-7dc7f9df3a4d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.369090 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22242a-38ce-4258-867b-7dc7f9df3a4d None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.369186 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968ad31-64b3-461e-aec5-615d51dfddb9 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:09.369829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22242a-38ce-4258-867b-7dc7f9df3a4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:09.370140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22242a-38ce-4258-867b-7dc7f9df3a4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:09.371596 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22242a-38ce-4258-867b-7dc7f9df3a4d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:09.377662 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 282/548] 10.222.0.65 () {56 vars in 1103 bytes} [Mon Jul 25 23:59:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:09.378456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968ad31-64b3-461e-aec5-615d51dfddb9 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:09.380935 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:09.384010 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 267/549] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:09.385393 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8f540-c4d3-448f-85b1-51db95bc1e8a None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.385680 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8f540-c4d3-448f-85b1-51db95bc1e8a None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.385956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8f540-c4d3-448f-85b1-51db95bc1e8a None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.387809 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 268/550] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:09.388493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8f540-c4d3-448f-85b1-51db95bc1e8a None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:09.399642 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:09.484557 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968ad31-64b3-461e-aec5-615d51dfddb9 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:09.489307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8f540-c4d3-448f-85b1-51db95bc1e8a None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:09.519047 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14248d8e-9214-41a8-b3d6-25b98e495015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:09.519682 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14248d8e-9214-41a8-b3d6-25b98e495015 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.519963 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14248d8e-9214-41a8-b3d6-25b98e495015 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.520243 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14248d8e-9214-41a8-b3d6-25b98e495015 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.522117 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7b158-b283-4fe6-a448-2cfe9478f5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:09.522974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7b158-b283-4fe6-a448-2cfe9478f5a7 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.523094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7b158-b283-4fe6-a448-2cfe9478f5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.523305 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7b158-b283-4fe6-a448-2cfe9478f5a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.532108 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14248d8e-9214-41a8-b3d6-25b98e495015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:09.533645 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7b158-b283-4fe6-a448-2cfe9478f5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:09.535118 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7b158-b283-4fe6-a448-2cfe9478f5a7 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-14248d8e-9214-41a8-b3d6-25b98e495015 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:09.537408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:09.538274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:09.539191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:09.539191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:09.539191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:09.539191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:09.539191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:09.539191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:09.539191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:09.539191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:09.539191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:09.539191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:09.539191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:09.539191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:09.542880 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 283/551] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:09.544402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14248d8e-9214-41a8-b3d6-25b98e495015 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-85a7b158-b283-4fe6-a448-2cfe9478f5a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:09.549856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:09.555817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:09.556693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:09.556693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:09.556693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:09.556693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:09.556693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 269/552] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:09.556693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b5a5-6e16-415e-b6fc-9df831d68c07 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.556693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b5a5-6e16-415e-b6fc-9df831d68c07 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.556693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b5a5-6e16-415e-b6fc-9df831d68c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.570273 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-ecf7b5a5-6e16-415e-b6fc-9df831d68c07 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:09.571493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-ecf7b5a5-6e16-415e-b6fc-9df831d68c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:09.605105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:09.626897 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:09.639919 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 270/553] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:09.640915 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b5a5-6e16-415e-b6fc-9df831d68c07 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:09.661343 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14248d8e-9214-41a8-b3d6-25b98e495015 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:09.694522 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dbcc2-22e8-4743-90fe-67ffe5fea74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:09.695219 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dbcc2-22e8-4743-90fe-67ffe5fea74c None admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.695499 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dbcc2-22e8-4743-90fe-67ffe5fea74c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.695783 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dbcc2-22e8-4743-90fe-67ffe5fea74c None admin] PATH_INFO: `/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/a513753b2f49408baf24402f1fa3c7e9/roles/6be878a30a464fc38706d4cab9d64f17` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.710594 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dbcc2-22e8-4743-90fe-67ffe5fea74c None admin] RBAC: Authorizing `identity:create_grant(project_id=4d685fe7e12e4d86a5d5db9253e7e11f, user_id=a513753b2f49408baf24402f1fa3c7e9, role_id=6be878a30a464fc38706d4cab9d64f17)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:09.712079 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dbcc2-22e8-4743-90fe-67ffe5fea74c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:09.725634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 284/554] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:59:09 2022] PUT /identity/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/a513753b2f49408baf24402f1fa3c7e9/roles/6be878a30a464fc38706d4cab9d64f17 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:59:09.726606 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dbcc2-22e8-4743-90fe-67ffe5fea74c None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:09.754455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b5a5-6e16-415e-b6fc-9df831d68c07 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:09.795529 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455dae2-97b1-4bc7-b24c-722a7c551373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:09.796467 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455dae2-97b1-4bc7-b24c-722a7c551373 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.796937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455dae2-97b1-4bc7-b24c-722a7c551373 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.797353 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455dae2-97b1-4bc7-b24c-722a7c551373 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.798248 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455dae2-97b1-4bc7-b24c-722a7c551373 None admin] RBAC: Adding query filter params (name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:09.798792 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455dae2-97b1-4bc7-b24c-722a7c551373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:09.800628 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455dae2-97b1-4bc7-b24c-722a7c551373 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:09.812295 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 271/555] 10.222.0.65 () {56 vars in 1103 bytes} [Mon Jul 25 23:59:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:09.813567 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455dae2-97b1-4bc7-b24c-722a7c551373 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:09.841099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dbcc2-22e8-4743-90fe-67ffe5fea74c None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:09.855309 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:09.882507 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:09.885096 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33ee2f-d7dc-4ac8-9d37-d3b44db801e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:09.885748 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ee2f-d7dc-4ac8-9d37-d3b44db801e1 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.886021 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ee2f-d7dc-4ac8-9d37-d3b44db801e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.886267 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ee2f-d7dc-4ac8-9d37-d3b44db801e1 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.887033 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33ee2f-d7dc-4ac8-9d37-d3b44db801e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:09.887331 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33ee2f-d7dc-4ac8-9d37-d3b44db801e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:09.888776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33ee2f-d7dc-4ac8-9d37-d3b44db801e1 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:09.901946 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 285/556] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:09.903404 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33ee2f-d7dc-4ac8-9d37-d3b44db801e1 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:09.940580 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455dae2-97b1-4bc7-b24c-722a7c551373 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:09.982749 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b160d-2bd4-40e2-b679-dae33e2f7b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:09.983820 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b160d-2bd4-40e2-b679-dae33e2f7b7f None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:09.984102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b160d-2bd4-40e2-b679-dae33e2f7b7f None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:09.984377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b160d-2bd4-40e2-b679-dae33e2f7b7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:09.998135 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b160d-2bd4-40e2-b679-dae33e2f7b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-500b160d-2bd4-40e2-b679-dae33e2f7b7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:10.003946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:10.005075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 272/557] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:10.005911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b160d-2bd4-40e2-b679-dae33e2f7b7f None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:10.030161 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33ee2f-d7dc-4ac8-9d37-d3b44db801e1 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:10.065226 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874d5c7-0066-473a-b512-b6d29568552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:10.065894 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874d5c7-0066-473a-b512-b6d29568552f None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:10.066151 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874d5c7-0066-473a-b512-b6d29568552f None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:10.066424 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874d5c7-0066-473a-b512-b6d29568552f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:10.077288 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874d5c7-0066-473a-b512-b6d29568552f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:10.078750 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874d5c7-0066-473a-b512-b6d29568552f None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-2874d5c7-0066-473a-b512-b6d29568552f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:10.095859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:10.096799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:10.102176 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:10.102176 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:10.102176 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:10.102176 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:10.102176 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 286/558] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:10.102176 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874d5c7-0066-473a-b512-b6d29568552f None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:10.115744 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b160d-2bd4-40e2-b679-dae33e2f7b7f None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:10.129424 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:10.132118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:10.153097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd797c79-9653-4bef-9cbf-a21e08a766c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:10.153658 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd797c79-9653-4bef-9cbf-a21e08a766c5 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:10.153941 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd797c79-9653-4bef-9cbf-a21e08a766c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:10.154219 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd797c79-9653-4bef-9cbf-a21e08a766c5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:10.162187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd797c79-9653-4bef-9cbf-a21e08a766c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:10.163735 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd797c79-9653-4bef-9cbf-a21e08a766c5 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-dd797c79-9653-4bef-9cbf-a21e08a766c5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:10.176102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:10.177582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:10.178581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:10.178581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:10.178581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:10.178581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:10.178581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:10.178581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:10.178581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:10.178581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:10.178581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 23:59:10.178581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:10.182249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 273/559] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:59:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:10.183126 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd797c79-9653-4bef-9cbf-a21e08a766c5 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:10.218782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874d5c7-0066-473a-b512-b6d29568552f None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:10.254743 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e1531-a409-4454-9684-c2814ebdae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:10.255524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e1531-a409-4454-9684-c2814ebdae3b None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:10.255902 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e1531-a409-4454-9684-c2814ebdae3b None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:10.256835 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e1531-a409-4454-9684-c2814ebdae3b None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:10.257619 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e1531-a409-4454-9684-c2814ebdae3b None admin] RBAC: Adding query filter params (name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:10.258048 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e1531-a409-4454-9684-c2814ebdae3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:10.259666 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e1531-a409-4454-9684-c2814ebdae3b None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:10.273034 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 287/560] 10.222.0.65 () {56 vars in 1103 bytes} [Mon Jul 25 23:59:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:10.273034 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e1531-a409-4454-9684-c2814ebdae3b None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:10.300467 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd797c79-9653-4bef-9cbf-a21e08a766c5 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:10.337603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab3f94-d1a7-4087-8d75-6969531f992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:10.338367 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab3f94-d1a7-4087-8d75-6969531f992a None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:10.338789 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab3f94-d1a7-4087-8d75-6969531f992a None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:10.339189 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab3f94-d1a7-4087-8d75-6969531f992a None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:10.339880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab3f94-d1a7-4087-8d75-6969531f992a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:10.340813 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab3f94-d1a7-4087-8d75-6969531f992a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:10.342174 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab3f94-d1a7-4087-8d75-6969531f992a None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:10.358847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 274/561] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:10.358847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab3f94-d1a7-4087-8d75-6969531f992a None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:10.365415 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:10.383721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e1531-a409-4454-9684-c2814ebdae3b None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:10.389978 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:10.420161 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24197108-d1dc-4c0c-a133-69a57d9742fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:10.420702 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24197108-d1dc-4c0c-a133-69a57d9742fb None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:10.420984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24197108-d1dc-4c0c-a133-69a57d9742fb None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:10.421260 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24197108-d1dc-4c0c-a133-69a57d9742fb None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:10.422488 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24197108-d1dc-4c0c-a133-69a57d9742fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:10.422838 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24197108-d1dc-4c0c-a133-69a57d9742fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:10.424279 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24197108-d1dc-4c0c-a133-69a57d9742fb None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:10.446140 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 288/562] 10.222.0.65 () {56 vars in 1137 bytes} [Mon Jul 25 23:59:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:10.446140 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24197108-d1dc-4c0c-a133-69a57d9742fb None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:10.478655 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab3f94-d1a7-4087-8d75-6969531f992a None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:10.515144 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ad65d-31b9-4151-9136-3a6f55d55cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:10.515788 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ad65d-31b9-4151-9136-3a6f55d55cfe None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:10.516100 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ad65d-31b9-4151-9136-3a6f55d55cfe None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:10.516345 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ad65d-31b9-4151-9136-3a6f55d55cfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:10.526752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ad65d-31b9-4151-9136-3a6f55d55cfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:10.528764 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ad65d-31b9-4151-9136-3a6f55d55cfe None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-c77ad65d-31b9-4151-9136-3a6f55d55cfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:10.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:10.544493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:10.545353 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:10.545353 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:10.545353 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:10.545353 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:10.545353 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 275/563] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:10.546139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ad65d-31b9-4151-9136-3a6f55d55cfe None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:10.556570 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24197108-d1dc-4c0c-a133-69a57d9742fb None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:10.592181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcc800-4a0a-4f04-b7cf-f50bf72a08e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:10.592820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcc800-4a0a-4f04-b7cf-f50bf72a08e6 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:10.593107 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcc800-4a0a-4f04-b7cf-f50bf72a08e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:10.593382 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcc800-4a0a-4f04-b7cf-f50bf72a08e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:10.601231 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcc800-4a0a-4f04-b7cf-f50bf72a08e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:10.602682 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcc800-4a0a-4f04-b7cf-f50bf72a08e6 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-32bcc800-4a0a-4f04-b7cf-f50bf72a08e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:10.615493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:10.616936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:10.617836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:10.617836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:10.617836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:10.617836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:10.617836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:10.617836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:10.617836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:10.617836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:10.617836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:59:10.617836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:10.617836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 289/564] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:59:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:10.617836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcc800-4a0a-4f04-b7cf-f50bf72a08e6 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:10.624396 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:10.642078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:10.662074 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ad65d-31b9-4151-9136-3a6f55d55cfe None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:10.697615 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5abc1-f76f-4b30-ba3e-02ddbd17d2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:10.698485 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5abc1-f76f-4b30-ba3e-02ddbd17d2b8 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:10.698629 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5abc1-f76f-4b30-ba3e-02ddbd17d2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:10.698803 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5abc1-f76f-4b30-ba3e-02ddbd17d2b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:10.709644 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5abc1-f76f-4b30-ba3e-02ddbd17d2b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:10.711501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5abc1-f76f-4b30-ba3e-02ddbd17d2b8 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-2df5abc1-f76f-4b30-ba3e-02ddbd17d2b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:10.726563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:10.727476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:10.728371 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:10.728371 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:10.728371 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:10.728371 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:10.728371 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 276/565] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:10.728639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5abc1-f76f-4b30-ba3e-02ddbd17d2b8 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:10.734145 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcc800-4a0a-4f04-b7cf-f50bf72a08e6 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:10.769399 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c01e0-1a73-49a6-9655-2c5225072e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:10.770010 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c01e0-1a73-49a6-9655-2c5225072e6e None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:10.770281 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c01e0-1a73-49a6-9655-2c5225072e6e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:10.770552 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c01e0-1a73-49a6-9655-2c5225072e6e None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:10.771258 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c01e0-1a73-49a6-9655-2c5225072e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:10.771557 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c01e0-1a73-49a6-9655-2c5225072e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:10.772921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c01e0-1a73-49a6-9655-2c5225072e6e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:10.785067 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 290/566] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:10.785854 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c01e0-1a73-49a6-9655-2c5225072e6e None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:10.841101 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5abc1-f76f-4b30-ba3e-02ddbd17d2b8 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:10.855627 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:10.881215 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e69d8-7000-41a6-905b-9d2e4f79ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:10.882051 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e69d8-7000-41a6-905b-9d2e4f79ce47 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:10.882464 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e69d8-7000-41a6-905b-9d2e4f79ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:10.882900 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e69d8-7000-41a6-905b-9d2e4f79ce47 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:10.883727 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e69d8-7000-41a6-905b-9d2e4f79ce47 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:10.884044 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e69d8-7000-41a6-905b-9d2e4f79ce47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:10.885538 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e69d8-7000-41a6-905b-9d2e4f79ce47 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:10.890080 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:10.907618 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c01e0-1a73-49a6-9655-2c5225072e6e None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:10.908269 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 277/567] 10.222.0.65 () {56 vars in 1137 bytes} [Mon Jul 25 23:59:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:10.909391 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e69d8-7000-41a6-905b-9d2e4f79ce47 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:10.946731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31989271-f151-4436-bf2e-be722cf57d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:10.947359 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31989271-f151-4436-bf2e-be722cf57d54 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:10.947690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31989271-f151-4436-bf2e-be722cf57d54 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:10.947913 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31989271-f151-4436-bf2e-be722cf57d54 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:10.948660 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31989271-f151-4436-bf2e-be722cf57d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:10.948969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31989271-f151-4436-bf2e-be722cf57d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:10.950519 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31989271-f151-4436-bf2e-be722cf57d54 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:10.966896 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 291/568] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:10.966896 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31989271-f151-4436-bf2e-be722cf57d54 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:11.048468 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e69d8-7000-41a6-905b-9d2e4f79ce47 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:11.084819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31989271-f151-4436-bf2e-be722cf57d54 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:11.089096 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50725039-d052-4cdd-83b5-544ef5215874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:11.089739 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50725039-d052-4cdd-83b5-544ef5215874 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:11.090049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50725039-d052-4cdd-83b5-544ef5215874 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:11.090371 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50725039-d052-4cdd-83b5-544ef5215874 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:11.099629 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50725039-d052-4cdd-83b5-544ef5215874 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:11.101243 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50725039-d052-4cdd-83b5-544ef5215874 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:11.112805 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-50725039-d052-4cdd-83b5-544ef5215874 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:11.115326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:11.116699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:11.117867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:11.117867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:11.117867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:11.117867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:11.117867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:11.117867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:11.117867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:11.117867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:11.117867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 23:59:11.117867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:11.117867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 278/569] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:11.117867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50725039-d052-4cdd-83b5-544ef5215874 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:11.131389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdf19c-504a-46bb-9c2c-f39f1e2048d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:11.132039 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdf19c-504a-46bb-9c2c-f39f1e2048d3 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:11.132321 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdf19c-504a-46bb-9c2c-f39f1e2048d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:11.132705 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdf19c-504a-46bb-9c2c-f39f1e2048d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:11.145236 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdf19c-504a-46bb-9c2c-f39f1e2048d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:11.147061 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdf19c-504a-46bb-9c2c-f39f1e2048d3 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-b5cdf19c-504a-46bb-9c2c-f39f1e2048d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:11.164209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:11.165339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:11.166810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:11.166810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:11.166810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:11.166810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:11.168925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 292/570] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:11.169178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdf19c-504a-46bb-9c2c-f39f1e2048d3 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:11.194694 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:11.250843 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50725039-d052-4cdd-83b5-544ef5215874 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:11.304326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09068cb-c559-450f-a9ec-26140e9bdd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:11.304965 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09068cb-c559-450f-a9ec-26140e9bdd65 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:11.305243 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09068cb-c559-450f-a9ec-26140e9bdd65 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:11.305528 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09068cb-c559-450f-a9ec-26140e9bdd65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:11.305635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdf19c-504a-46bb-9c2c-f39f1e2048d3 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:11.313581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09068cb-c559-450f-a9ec-26140e9bdd65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:11.315312 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09068cb-c559-450f-a9ec-26140e9bdd65 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-a09068cb-c559-450f-a9ec-26140e9bdd65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:11.332205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:11.333249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:11.334129 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:11.334129 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:11.334129 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:11.334129 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:11.334129 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:11.334129 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:11.334129 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:11.334129 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:11.334129 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 279/571] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:11.334610 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09068cb-c559-450f-a9ec-26140e9bdd65 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:11.348859 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9698f5-18c8-4af1-8f4a-49e9401c87c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:11.349488 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9698f5-18c8-4af1-8f4a-49e9401c87c1 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:11.349773 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9698f5-18c8-4af1-8f4a-49e9401c87c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:11.350133 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9698f5-18c8-4af1-8f4a-49e9401c87c1 None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:11.350956 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9698f5-18c8-4af1-8f4a-49e9401c87c1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:11.351262 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9698f5-18c8-4af1-8f4a-49e9401c87c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:11.352769 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9698f5-18c8-4af1-8f4a-49e9401c87c1 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:11.376171 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 293/572] 10.222.0.65 () {56 vars in 1139 bytes} [Mon Jul 25 23:59:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:11.378386 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9698f5-18c8-4af1-8f4a-49e9401c87c1 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:11.420950 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:11.477197 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09068cb-c559-450f-a9ec-26140e9bdd65 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:11.492958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:11.506491 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9698f5-18c8-4af1-8f4a-49e9401c87c1 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:11.521659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad0790-eb38-4789-af56-b72f7e9bba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:11.522370 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0790-eb38-4789-af56-b72f7e9bba8e None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:11.522730 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0790-eb38-4789-af56-b72f7e9bba8e None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:11.523094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0790-eb38-4789-af56-b72f7e9bba8e None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:11.523847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad0790-eb38-4789-af56-b72f7e9bba8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:11.524539 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad0790-eb38-4789-af56-b72f7e9bba8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:11.526310 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad0790-eb38-4789-af56-b72f7e9bba8e None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:11.547067 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 280/573] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:11.548538 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad0790-eb38-4789-af56-b72f7e9bba8e None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:11.555490 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88f42e-0b7e-468e-9d3c-d02a42d72480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:11.556114 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f42e-0b7e-468e-9d3c-d02a42d72480 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:11.556391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f42e-0b7e-468e-9d3c-d02a42d72480 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:11.556661 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f42e-0b7e-468e-9d3c-d02a42d72480 None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:11.557506 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88f42e-0b7e-468e-9d3c-d02a42d72480 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:11.558994 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88f42e-0b7e-468e-9d3c-d02a42d72480 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:11.560458 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88f42e-0b7e-468e-9d3c-d02a42d72480 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:11.580222 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 294/574] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:11.580222 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88f42e-0b7e-468e-9d3c-d02a42d72480 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:11.686014 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad0790-eb38-4789-af56-b72f7e9bba8e None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:11.694368 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:11.706213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88f42e-0b7e-468e-9d3c-d02a42d72480 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:11.730431 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f321b-efa3-4c93-8fe0-b84e46e94435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:11.731295 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f321b-efa3-4c93-8fe0-b84e46e94435 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:11.731784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f321b-efa3-4c93-8fe0-b84e46e94435 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:11.732233 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f321b-efa3-4c93-8fe0-b84e46e94435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:11.745048 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab87b3-2ad5-449c-a729-bc3525f7a51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:11.745693 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab87b3-2ad5-449c-a729-bc3525f7a51f None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:11.745976 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab87b3-2ad5-449c-a729-bc3525f7a51f None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:11.746323 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab87b3-2ad5-449c-a729-bc3525f7a51f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:11.749855 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f321b-efa3-4c93-8fe0-b84e46e94435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:11.751391 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f321b-efa3-4c93-8fe0-b84e46e94435 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:11.753576 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab87b3-2ad5-449c-a729-bc3525f7a51f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:11.755055 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab87b3-2ad5-449c-a729-bc3525f7a51f None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-9dab87b3-2ad5-449c-a729-bc3525f7a51f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:11.768984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:11.769908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:11.770831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:11.770831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:11.770831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:11.770831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:11.770831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:11.770831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:11.770831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:11.770831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:11.770831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 295/575] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:11.771339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab87b3-2ad5-449c-a729-bc3525f7a51f None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-7f9f321b-efa3-4c93-8fe0-b84e46e94435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:11.774848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:11.775760 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:11.776666 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:11.776666 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:11.776666 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:11.776666 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:11.779075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 281/576] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:11.780282 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f321b-efa3-4c93-8fe0-b84e46e94435 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:11.811073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:11.892331 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f321b-efa3-4c93-8fe0-b84e46e94435 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:11.897972 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab87b3-2ad5-449c-a729-bc3525f7a51f None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:11.930597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c33c32-0d8b-4491-abb6-88c6d0759fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:11.931269 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c33c32-0d8b-4491-abb6-88c6d0759fbe None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:11.931562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c33c32-0d8b-4491-abb6-88c6d0759fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:11.931841 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c33c32-0d8b-4491-abb6-88c6d0759fbe None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:11.932609 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c33c32-0d8b-4491-abb6-88c6d0759fbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:11.932924 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c33c32-0d8b-4491-abb6-88c6d0759fbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:11.935118 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c33c32-0d8b-4491-abb6-88c6d0759fbe None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:11.936997 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21204b67-688f-4148-a265-e509f1a507fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:11.937686 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21204b67-688f-4148-a265-e509f1a507fa None admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:11.937966 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21204b67-688f-4148-a265-e509f1a507fa None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:11.938235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21204b67-688f-4148-a265-e509f1a507fa None admin] PATH_INFO: `/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/cbc09289c7e645b189776f109b78968e/roles/6be878a30a464fc38706d4cab9d64f17` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:11.949444 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 282/577] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:11.950324 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c33c32-0d8b-4491-abb6-88c6d0759fbe None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:11.960784 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21204b67-688f-4148-a265-e509f1a507fa None admin] RBAC: Authorizing `identity:create_grant(project_id=4d685fe7e12e4d86a5d5db9253e7e11f, user_id=cbc09289c7e645b189776f109b78968e, role_id=6be878a30a464fc38706d4cab9d64f17)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:11.962232 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21204b67-688f-4148-a265-e509f1a507fa None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:11.987434 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 296/578] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:59:11 2022] PUT /identity/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/cbc09289c7e645b189776f109b78968e/roles/6be878a30a464fc38706d4cab9d64f17 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:59:11.988416 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21204b67-688f-4148-a265-e509f1a507fa None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:12.004802 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:12.061523 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:12.082166 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c33c32-0d8b-4491-abb6-88c6d0759fbe None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:12.124093 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca103ef-886b-4758-a117-b8ef2b622033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:12.124738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca103ef-886b-4758-a117-b8ef2b622033 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:12.125191 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca103ef-886b-4758-a117-b8ef2b622033 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:12.125470 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca103ef-886b-4758-a117-b8ef2b622033 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:12.126204 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca103ef-886b-4758-a117-b8ef2b622033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:12.126517 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca103ef-886b-4758-a117-b8ef2b622033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:12.127990 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca103ef-886b-4758-a117-b8ef2b622033 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:12.138184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21204b67-688f-4148-a265-e509f1a507fa None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:12.142586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 283/579] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:12.144258 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07570bb-f263-48a8-aff9-655a5f7fc9c3 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:12.144716 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07570bb-f263-48a8-aff9-655a5f7fc9c3 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:12.145184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07570bb-f263-48a8-aff9-655a5f7fc9c3 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:12.147763 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 284/580] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:12.149293 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07570bb-f263-48a8-aff9-655a5f7fc9c3 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:12.181529 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4839-fb3b-4ab8-9c80-f2f58a764407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:12.182226 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4839-fb3b-4ab8-9c80-f2f58a764407 None admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:12.182507 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4839-fb3b-4ab8-9c80-f2f58a764407 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:12.182801 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4839-fb3b-4ab8-9c80-f2f58a764407 None admin] PATH_INFO: `/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/5f8a981708a34de5be7cda18eb8bb1a3/roles/6be878a30a464fc38706d4cab9d64f17` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:12.201102 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a4839-fb3b-4ab8-9c80-f2f58a764407 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d685fe7e12e4d86a5d5db9253e7e11f, user_id=5f8a981708a34de5be7cda18eb8bb1a3, role_id=6be878a30a464fc38706d4cab9d64f17)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:12.201984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a4839-fb3b-4ab8-9c80-f2f58a764407 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:12.217169 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 297/581] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:59:11 2022] PUT /identity/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/5f8a981708a34de5be7cda18eb8bb1a3/roles/6be878a30a464fc38706d4cab9d64f17 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:59:12.222073 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e5523-801e-42eb-b58e-4c3b38ea4561 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:12.222073 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e5523-801e-42eb-b58e-4c3b38ea4561 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:12.222073 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e5523-801e-42eb-b58e-4c3b38ea4561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:12.238610 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-671e5523-801e-42eb-b58e-4c3b38ea4561 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:12.239902 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-671e5523-801e-42eb-b58e-4c3b38ea4561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:12.282796 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07570bb-f263-48a8-aff9-655a5f7fc9c3 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:12.318501 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:12.335909 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459f81d-0e98-4168-b571-e241b70e11d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:12.336575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459f81d-0e98-4168-b571-e241b70e11d3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:12.336861 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459f81d-0e98-4168-b571-e241b70e11d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:12.337137 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459f81d-0e98-4168-b571-e241b70e11d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:12.345799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459f81d-0e98-4168-b571-e241b70e11d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:12.347404 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459f81d-0e98-4168-b571-e241b70e11d3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:12.347677 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 298/582] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-5459f81d-0e98-4168-b571-e241b70e11d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:12.364536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:12.365471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:12.366344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:12.366344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:12.366344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:12.366344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:12.366344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:12.366344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:12.366344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:12.366344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:12.366344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 285/583] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:12.372084 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e5523-801e-42eb-b58e-4c3b38ea4561 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:12.379911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459f81d-0e98-4168-b571-e241b70e11d3 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:12.391405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:12.500217 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459f81d-0e98-4168-b571-e241b70e11d3 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:12.519327 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e5523-801e-42eb-b58e-4c3b38ea4561 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:12.543903 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fe11b-98bb-4c75-b9e9-be33048d1fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:12.544822 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fe11b-98bb-4c75-b9e9-be33048d1fdc None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:12.545253 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fe11b-98bb-4c75-b9e9-be33048d1fdc None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:12.545690 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fe11b-98bb-4c75-b9e9-be33048d1fdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:12.556763 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fe11b-98bb-4c75-b9e9-be33048d1fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-916fe11b-98bb-4c75-b9e9-be33048d1fdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:12.563307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:12.564220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:12.565023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:12.565023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:12.565023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:12.565023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:12.565023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:12.565023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:12.565023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:12.565023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:12.565023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:12.565023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:12.565023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:12.565023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:12.566886 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2d39c-6940-4a2c-ba92-0ad6293be984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:12.567582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2d39c-6940-4a2c-ba92-0ad6293be984 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:12.567949 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2d39c-6940-4a2c-ba92-0ad6293be984 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:12.568296 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2d39c-6940-4a2c-ba92-0ad6293be984 None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:12.568554 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 286/584] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:12.569162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2d39c-6940-4a2c-ba92-0ad6293be984 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:12.569545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2d39c-6940-4a2c-ba92-0ad6293be984 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:12.574939 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2d39c-6940-4a2c-ba92-0ad6293be984 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:12.575082 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fe11b-98bb-4c75-b9e9-be33048d1fdc None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:12.587388 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 299/585] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:12.594359 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2d39c-6940-4a2c-ba92-0ad6293be984 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:12.646843 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:12.661659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:12.701653 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fe11b-98bb-4c75-b9e9-be33048d1fdc None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:12.711014 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2d39c-6940-4a2c-ba92-0ad6293be984 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:12.738116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbb0c7-f86e-4ff8-ba52-98891c942e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:12.738758 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbb0c7-f86e-4ff8-ba52-98891c942e6d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:12.739047 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbb0c7-f86e-4ff8-ba52-98891c942e6d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:12.739325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbb0c7-f86e-4ff8-ba52-98891c942e6d None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:12.740037 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbb0c7-f86e-4ff8-ba52-98891c942e6d None admin] RBAC: Adding query filter params (name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:12.740342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbb0c7-f86e-4ff8-ba52-98891c942e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:12.741786 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbb0c7-f86e-4ff8-ba52-98891c942e6d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:12.750817 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9117f2-d07a-462c-87c0-0e998e5de773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:12.751781 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9117f2-d07a-462c-87c0-0e998e5de773 None admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:12.752268 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9117f2-d07a-462c-87c0-0e998e5de773 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:12.752751 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9117f2-d07a-462c-87c0-0e998e5de773 None admin] PATH_INFO: `/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/d4e34b7f817f452faabd2d32d1af3ab8/roles/6be878a30a464fc38706d4cab9d64f17` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:12.754778 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 287/586] 10.222.0.65 () {56 vars in 1103 bytes} [Mon Jul 25 23:59:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:12.757919 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbb0c7-f86e-4ff8-ba52-98891c942e6d None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:12.773678 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9117f2-d07a-462c-87c0-0e998e5de773 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d685fe7e12e4d86a5d5db9253e7e11f, user_id=d4e34b7f817f452faabd2d32d1af3ab8, role_id=6be878a30a464fc38706d4cab9d64f17)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:12.775506 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9117f2-d07a-462c-87c0-0e998e5de773 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:12.794763 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 300/587] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:59:12 2022] PUT /identity/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/d4e34b7f817f452faabd2d32d1af3ab8/roles/6be878a30a464fc38706d4cab9d64f17 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:59:12.876102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbb0c7-f86e-4ff8-ba52-98891c942e6d None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:12.907127 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:12.915941 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62056b72-6bcf-4782-9ba3-beffdafab7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:12.916656 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62056b72-6bcf-4782-9ba3-beffdafab7cc None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:12.916948 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62056b72-6bcf-4782-9ba3-beffdafab7cc None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:12.917230 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62056b72-6bcf-4782-9ba3-beffdafab7cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:12.930094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62056b72-6bcf-4782-9ba3-beffdafab7cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:12.931906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62056b72-6bcf-4782-9ba3-beffdafab7cc None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-62056b72-6bcf-4782-9ba3-beffdafab7cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:12.948381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:12.949819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:12.950732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:12.950732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:12.950732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:12.950732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:12.950732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 288/588] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:59:12.956000 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9117f2-d07a-462c-87c0-0e998e5de773 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:13.062233 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:13.069363 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9117f2-d07a-462c-87c0-0e998e5de773 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:13.108121 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5d1f9-2439-4dd1-9e3b-e10a22a6a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:13.108744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5d1f9-2439-4dd1-9e3b-e10a22a6a6e9 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:13.109027 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5d1f9-2439-4dd1-9e3b-e10a22a6a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:13.109305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5d1f9-2439-4dd1-9e3b-e10a22a6a6e9 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:13.109994 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5d1f9-2439-4dd1-9e3b-e10a22a6a6e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:13.110300 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5d1f9-2439-4dd1-9e3b-e10a22a6a6e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:13.111715 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5d1f9-2439-4dd1-9e3b-e10a22a6a6e9 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:13.125214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 301/589] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:13.130618 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62056b72-6bcf-4782-9ba3-beffdafab7cc None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:13.246507 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62056b72-6bcf-4782-9ba3-beffdafab7cc None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:13.282384 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebec6ad-1343-487b-9235-dab5e3eeb1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:13.283493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebec6ad-1343-487b-9235-dab5e3eeb1f3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:13.283775 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebec6ad-1343-487b-9235-dab5e3eeb1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:13.284055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebec6ad-1343-487b-9235-dab5e3eeb1f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:13.293762 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebec6ad-1343-487b-9235-dab5e3eeb1f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:13.295272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebec6ad-1343-487b-9235-dab5e3eeb1f3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-bebec6ad-1343-487b-9235-dab5e3eeb1f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:13.307198 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:13.308138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:13.309122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:13.309122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:13.309122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:13.309122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:13.309122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:13.309122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:13.309122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:13.309122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:13.309122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:59:13.309122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:13.309122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 289/590] 10.222.0.65 () {56 vars in 1093 bytes} [Mon Jul 25 23:59:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:13.317019 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5d1f9-2439-4dd1-9e3b-e10a22a6a6e9 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:13.424161 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5d1f9-2439-4dd1-9e3b-e10a22a6a6e9 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:13.460583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9c58a-cc04-4409-9fa5-303f47d73e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:13.461538 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9c58a-cc04-4409-9fa5-303f47d73e2e None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:13.462025 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9c58a-cc04-4409-9fa5-303f47d73e2e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:13.462501 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9c58a-cc04-4409-9fa5-303f47d73e2e None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:13.463525 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9c58a-cc04-4409-9fa5-303f47d73e2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:13.464099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9c58a-cc04-4409-9fa5-303f47d73e2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:13.465771 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9c58a-cc04-4409-9fa5-303f47d73e2e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:13.484613 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 302/591] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Jul 25 23:59:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:13.490523 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebec6ad-1343-487b-9235-dab5e3eeb1f3 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:13.538509 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:13.601227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebec6ad-1343-487b-9235-dab5e3eeb1f3 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:13.637260 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe810-6aa9-4d0a-bfc5-a0b56d4dbdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:13.638231 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe810-6aa9-4d0a-bfc5-a0b56d4dbdc0 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:13.638738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe810-6aa9-4d0a-bfc5-a0b56d4dbdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:13.639243 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fe810-6aa9-4d0a-bfc5-a0b56d4dbdc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:13.712113 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe810-6aa9-4d0a-bfc5-a0b56d4dbdc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:13.713911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fe810-6aa9-4d0a-bfc5-a0b56d4dbdc0 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:13.755385 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:13.822462 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 290/592] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:59:13.828599 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9c58a-cc04-4409-9fa5-303f47d73e2e None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:13.845257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:13.934356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9c58a-cc04-4409-9fa5-303f47d73e2e None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:13.971546 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0e6a9-16cf-47c9-8b79-1b9bf3a5e5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:13.971546 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e6a9-16cf-47c9-8b79-1b9bf3a5e5e4 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:13.971814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e6a9-16cf-47c9-8b79-1b9bf3a5e5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:13.972058 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e6a9-16cf-47c9-8b79-1b9bf3a5e5e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:13.984514 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0e6a9-16cf-47c9-8b79-1b9bf3a5e5e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:13.986007 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0e6a9-16cf-47c9-8b79-1b9bf3a5e5e4 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-71c0e6a9-16cf-47c9-8b79-1b9bf3a5e5e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:14.002445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:14.003384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:14.004244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:14.004244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:14.004244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:14.004244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:14.004244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 303/593] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:14.009582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe810-6aa9-4d0a-bfc5-a0b56d4dbdc0 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:14.120878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fe810-6aa9-4d0a-bfc5-a0b56d4dbdc0 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:14.156930 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b472f-0ac9-4e69-be9b-a298c527a3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:14.157886 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b472f-0ac9-4e69-be9b-a298c527a3fe None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:14.158350 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b472f-0ac9-4e69-be9b-a298c527a3fe None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:14.158827 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b472f-0ac9-4e69-be9b-a298c527a3fe None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:14.159686 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b472f-0ac9-4e69-be9b-a298c527a3fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:14.160184 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b472f-0ac9-4e69-be9b-a298c527a3fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:14.161744 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b472f-0ac9-4e69-be9b-a298c527a3fe None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:14.174501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 291/594] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:14.175077 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:14.180806 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0e6a9-16cf-47c9-8b79-1b9bf3a5e5e4 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:14.251973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:14.293691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0e6a9-16cf-47c9-8b79-1b9bf3a5e5e4 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:14.333810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d66e2-64f0-4af9-acfb-84c279f2382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:14.334878 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d66e2-64f0-4af9-acfb-84c279f2382c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:14.335380 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d66e2-64f0-4af9-acfb-84c279f2382c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:14.335866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d66e2-64f0-4af9-acfb-84c279f2382c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:14.343936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d66e2-64f0-4af9-acfb-84c279f2382c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:14.345634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d66e2-64f0-4af9-acfb-84c279f2382c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-a68d66e2-64f0-4af9-acfb-84c279f2382c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:14.357924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:14.358870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:14.359784 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:14.359784 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:14.359784 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:14.359784 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:14.359784 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:14.359784 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:14.359784 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:14.359784 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:14.362146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 304/595] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:14.374441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b472f-0ac9-4e69-be9b-a298c527a3fe None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:14.469061 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d6f5d-988a-4c4f-9129-049af322042d None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:14.469406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d6f5d-988a-4c4f-9129-049af322042d None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:14.469675 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d6f5d-988a-4c4f-9129-049af322042d None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:14.471769 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 305/596] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:59:14.481960 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56666d5e-7f3b-47fc-aba8-012e456dcc92 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:14.482356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56666d5e-7f3b-47fc-aba8-012e456dcc92 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:14.483221 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56666d5e-7f3b-47fc-aba8-012e456dcc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:14.485910 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b472f-0ac9-4e69-be9b-a298c527a3fe None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:14.506699 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-56666d5e-7f3b-47fc-aba8-012e456dcc92 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:14.508038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-56666d5e-7f3b-47fc-aba8-012e456dcc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:14.526956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc73d1-77f8-4db6-8a56-987efcd6bdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:14.528117 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc73d1-77f8-4db6-8a56-987efcd6bdba None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:14.528400 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc73d1-77f8-4db6-8a56-987efcd6bdba None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:14.528680 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc73d1-77f8-4db6-8a56-987efcd6bdba None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:14.529530 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc73d1-77f8-4db6-8a56-987efcd6bdba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:14.529841 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc73d1-77f8-4db6-8a56-987efcd6bdba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:14.531367 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc73d1-77f8-4db6-8a56-987efcd6bdba None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:14.547585 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 292/597] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:14.554262 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc73d1-77f8-4db6-8a56-987efcd6bdba None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:14.602811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 306/598] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:14.619347 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56666d5e-7f3b-47fc-aba8-012e456dcc92 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:14.619838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:14.666580 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc73d1-77f8-4db6-8a56-987efcd6bdba None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:14.680120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:14.708926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef10f06-bf5e-4d95-bab9-31dbbe01392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:14.709566 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10f06-bf5e-4d95-bab9-31dbbe01392b None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:14.709819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10f06-bf5e-4d95-bab9-31dbbe01392b None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:14.710094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10f06-bf5e-4d95-bab9-31dbbe01392b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:14.710899 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef10f06-bf5e-4d95-bab9-31dbbe01392b None admin] RBAC: Adding query filter params (role.id=6be878a30a464fc38706d4cab9d64f17, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=a513753b2f49408baf24402f1fa3c7e9) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:14.711210 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef10f06-bf5e-4d95-bab9-31dbbe01392b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:14.712871 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef10f06-bf5e-4d95-bab9-31dbbe01392b None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:14.727079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 293/599] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:59:14 2022] GET /identity/v3/role_assignments?user.id=a513753b2f49408baf24402f1fa3c7e9&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=6be878a30a464fc38706d4cab9d64f17 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:14.728364 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fdde9-386c-4635-b905-d81df6501182 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:14.728490 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56666d5e-7f3b-47fc-aba8-012e456dcc92 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:14.728679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fdde9-386c-4635-b905-d81df6501182 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:14.728926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fdde9-386c-4635-b905-d81df6501182 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:14.735788 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 294/600] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:14.736805 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbada733-b226-42e2-832e-9fc0f5f2a04c None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:14.737190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbada733-b226-42e2-832e-9fc0f5f2a04c None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:14.737564 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbada733-b226-42e2-832e-9fc0f5f2a04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:14.759632 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-cbada733-b226-42e2-832e-9fc0f5f2a04c None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:14.760894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-cbada733-b226-42e2-832e-9fc0f5f2a04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:14.775655 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdf905-0fcc-44da-884a-836dd43eda01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:14.776623 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdf905-0fcc-44da-884a-836dd43eda01 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:14.777077 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdf905-0fcc-44da-884a-836dd43eda01 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:14.777534 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdf905-0fcc-44da-884a-836dd43eda01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:14.792811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdf905-0fcc-44da-884a-836dd43eda01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-c8fdf905-0fcc-44da-884a-836dd43eda01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:14.798827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:14.799944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:14.800832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:14.800832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:14.800832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:14.800832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:14.800832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:14.800832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:14.800832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:14.800832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:14.800832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:14.800832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:14.800832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:14.800832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:14.808487 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 307/601] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:14.809971 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdf905-0fcc-44da-884a-836dd43eda01 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:14.854885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 295/602] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:59:14.875897 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbada733-b226-42e2-832e-9fc0f5f2a04c None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:14.924878 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdf905-0fcc-44da-884a-836dd43eda01 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:14.940214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:14.945852 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:14.968236 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb94f6-0b26-489c-a291-c720e1f2c213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:14.969752 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb94f6-0b26-489c-a291-c720e1f2c213 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:14.970238 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb94f6-0b26-489c-a291-c720e1f2c213 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:14.970690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb94f6-0b26-489c-a291-c720e1f2c213 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:14.971972 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb94f6-0b26-489c-a291-c720e1f2c213 None admin] RBAC: Adding query filter params (name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:14.972747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb94f6-0b26-489c-a291-c720e1f2c213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:14.974692 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb94f6-0b26-489c-a291-c720e1f2c213 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:14.987041 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 308/603] 10.222.0.65 () {56 vars in 1103 bytes} [Mon Jul 25 23:59:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:14.992064 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb94f6-0b26-489c-a291-c720e1f2c213 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:15.004696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbada733-b226-42e2-832e-9fc0f5f2a04c None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:15.051238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc9713-a811-4af0-b948-04d0a3c64a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:15.052577 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc9713-a811-4af0-b948-04d0a3c64a27 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:15.052867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc9713-a811-4af0-b948-04d0a3c64a27 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:15.053141 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc9713-a811-4af0-b948-04d0a3c64a27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:15.067114 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc9713-a811-4af0-b948-04d0a3c64a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-2fbc9713-a811-4af0-b948-04d0a3c64a27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:15.071962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:15.073076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:15.074070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 296/604] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:59:15.081896 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc9713-a811-4af0-b948-04d0a3c64a27 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:15.117830 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb94f6-0b26-489c-a291-c720e1f2c213 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:15.156952 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd06d4-5d2b-4e46-918d-7dd9b2ade95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:15.158118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd06d4-5d2b-4e46-918d-7dd9b2ade95e None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:15.159406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd06d4-5d2b-4e46-918d-7dd9b2ade95e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:15.159711 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd06d4-5d2b-4e46-918d-7dd9b2ade95e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:15.172591 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd06d4-5d2b-4e46-918d-7dd9b2ade95e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:15.174413 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd06d4-5d2b-4e46-918d-7dd9b2ade95e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-1dbd06d4-5d2b-4e46-918d-7dd9b2ade95e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:15.192218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:15.193337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:15.194432 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:15.194432 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:15.194432 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:15.194432 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:15.196306 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 309/605] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:59:15.197576 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d285e7-4e15-4165-8480-7c9889e9fdcd None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:15.197935 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d285e7-4e15-4165-8480-7c9889e9fdcd None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:15.198276 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d285e7-4e15-4165-8480-7c9889e9fdcd None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:15.200470 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 310/606] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:15.203886 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d285e7-4e15-4165-8480-7c9889e9fdcd None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:15.208404 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc9713-a811-4af0-b948-04d0a3c64a27 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:15.224755 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:15.234972 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:15.248530 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ed7cc-e12e-4d55-a793-bb49ed9fd1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:15.249150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ed7cc-e12e-4d55-a793-bb49ed9fd1fe None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:15.249432 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ed7cc-e12e-4d55-a793-bb49ed9fd1fe None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:15.249708 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ed7cc-e12e-4d55-a793-bb49ed9fd1fe None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:15.250423 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ed7cc-e12e-4d55-a793-bb49ed9fd1fe None admin] RBAC: Adding query filter params (name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:15.250865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ed7cc-e12e-4d55-a793-bb49ed9fd1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:15.252137 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ed7cc-e12e-4d55-a793-bb49ed9fd1fe None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:15.261252 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 297/607] 10.222.0.65 () {56 vars in 1103 bytes} [Mon Jul 25 23:59:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:15.263228 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85020d02-72f5-4cac-a1c9-db43aa07d6ff None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:15.263691 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85020d02-72f5-4cac-a1c9-db43aa07d6ff None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:15.264237 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85020d02-72f5-4cac-a1c9-db43aa07d6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:15.283588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-85020d02-72f5-4cac-a1c9-db43aa07d6ff None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:15.284785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-85020d02-72f5-4cac-a1c9-db43aa07d6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:15.319765 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d285e7-4e15-4165-8480-7c9889e9fdcd None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:15.353806 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 298/608] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:15.354656 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85020d02-72f5-4cac-a1c9-db43aa07d6ff None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:15.368427 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d31b71-d9fb-4a38-a0b6-2b6836e39982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:15.369785 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d31b71-d9fb-4a38-a0b6-2b6836e39982 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:15.370297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d31b71-d9fb-4a38-a0b6-2b6836e39982 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:15.371793 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d31b71-d9fb-4a38-a0b6-2b6836e39982 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:15.372992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d31b71-d9fb-4a38-a0b6-2b6836e39982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:15.373479 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d31b71-d9fb-4a38-a0b6-2b6836e39982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:15.375799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d31b71-d9fb-4a38-a0b6-2b6836e39982 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:15.390854 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 311/609] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:15.392027 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d31b71-d9fb-4a38-a0b6-2b6836e39982 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:15.468621 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85020d02-72f5-4cac-a1c9-db43aa07d6ff None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:15.475902 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:15.485557 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:15.499572 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d31b71-d9fb-4a38-a0b6-2b6836e39982 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:15.506597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be29ca1-1676-49ad-89d7-a680dd6d546f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:15.507445 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be29ca1-1676-49ad-89d7-a680dd6d546f None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:15.507881 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be29ca1-1676-49ad-89d7-a680dd6d546f None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:15.508294 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be29ca1-1676-49ad-89d7-a680dd6d546f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:15.519401 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be29ca1-1676-49ad-89d7-a680dd6d546f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:15.521447 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be29ca1-1676-49ad-89d7-a680dd6d546f None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:15.534583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c505db6-3c2c-4d05-98a3-4162a262d663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:15.535248 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c505db6-3c2c-4d05-98a3-4162a262d663 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:15.535530 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c505db6-3c2c-4d05-98a3-4162a262d663 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:15.535810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c505db6-3c2c-4d05-98a3-4162a262d663 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-8be29ca1-1676-49ad-89d7-a680dd6d546f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:15.537991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:15.539015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:15.540095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:15.540095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:15.540095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:15.540095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:15.541911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 299/610] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:15.543620 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be29ca1-1676-49ad-89d7-a680dd6d546f None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:15.551611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c505db6-3c2c-4d05-98a3-4162a262d663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-4c505db6-3c2c-4d05-98a3-4162a262d663 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:15.556778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:15.557889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 312/611] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:15.558832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c505db6-3c2c-4d05-98a3-4162a262d663 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:15.653795 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be29ca1-1676-49ad-89d7-a680dd6d546f None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:15.666899 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c505db6-3c2c-4d05-98a3-4162a262d663 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:15.690415 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dceff3-8b24-4f7f-b50b-0cf3474356b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:15.691304 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dceff3-8b24-4f7f-b50b-0cf3474356b2 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:15.691725 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dceff3-8b24-4f7f-b50b-0cf3474356b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:15.692137 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dceff3-8b24-4f7f-b50b-0cf3474356b2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:15.700403 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dceff3-8b24-4f7f-b50b-0cf3474356b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:15.702013 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dceff3-8b24-4f7f-b50b-0cf3474356b2 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:15.704189 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a14a6-419c-44b1-80a6-da4c49a3a221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:15.704800 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a14a6-419c-44b1-80a6-da4c49a3a221 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:15.705083 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a14a6-419c-44b1-80a6-da4c49a3a221 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:15.705362 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a14a6-419c-44b1-80a6-da4c49a3a221 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:15.706039 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a14a6-419c-44b1-80a6-da4c49a3a221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:15.706345 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a14a6-419c-44b1-80a6-da4c49a3a221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:15.707732 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a14a6-419c-44b1-80a6-da4c49a3a221 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-35dceff3-8b24-4f7f-b50b-0cf3474356b2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:15.714372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:15.715493 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:15.721238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:15.721238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:15.721238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:15.721238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:15.721238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:15.721238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:15.721238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:15.721238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:15.721238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 23:59:15.721238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:15.721238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 300/612] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:59:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:15.721238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dceff3-8b24-4f7f-b50b-0cf3474356b2 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:15.721911 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 313/613] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:15.722969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a14a6-419c-44b1-80a6-da4c49a3a221 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:15.734572 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:15.742492 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:15.829042 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dceff3-8b24-4f7f-b50b-0cf3474356b2 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:15.829377 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a14a6-419c-44b1-80a6-da4c49a3a221 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:15.864181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3233df7-5fc9-44bb-b65e-3278491d9246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:15.864791 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3233df7-5fc9-44bb-b65e-3278491d9246 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:15.865066 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3233df7-5fc9-44bb-b65e-3278491d9246 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:15.865328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3233df7-5fc9-44bb-b65e-3278491d9246 None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:15.865669 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5849cb-90d2-4274-b044-010a9cc415e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:15.866095 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3233df7-5fc9-44bb-b65e-3278491d9246 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:15.866285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5849cb-90d2-4274-b044-010a9cc415e4 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:15.866391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3233df7-5fc9-44bb-b65e-3278491d9246 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:15.866571 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5849cb-90d2-4274-b044-010a9cc415e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:15.866935 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5849cb-90d2-4274-b044-010a9cc415e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:15.867641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5849cb-90d2-4274-b044-010a9cc415e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:15.867852 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3233df7-5fc9-44bb-b65e-3278491d9246 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:15.867947 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5849cb-90d2-4274-b044-010a9cc415e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:15.869288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5849cb-90d2-4274-b044-010a9cc415e4 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:15.878919 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 301/614] 10.222.0.65 () {56 vars in 1103 bytes} [Mon Jul 25 23:59:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:15.879786 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5849cb-90d2-4274-b044-010a9cc415e4 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:15.888140 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 314/615] 10.222.0.65 () {56 vars in 1137 bytes} [Mon Jul 25 23:59:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:15.889227 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3233df7-5fc9-44bb-b65e-3278491d9246 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:15.960535 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:15.966691 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:15.992049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5849cb-90d2-4274-b044-010a9cc415e4 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:16.004274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3233df7-5fc9-44bb-b65e-3278491d9246 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:16.028206 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b0809-219b-4d0e-ab4e-72b6145a7f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:16.028861 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b0809-219b-4d0e-ab4e-72b6145a7f44 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:16.029154 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b0809-219b-4d0e-ab4e-72b6145a7f44 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:16.029433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b0809-219b-4d0e-ab4e-72b6145a7f44 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:16.038177 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b0809-219b-4d0e-ab4e-72b6145a7f44 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:16.039704 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b0809-219b-4d0e-ab4e-72b6145a7f44 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:16.041802 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3a3e7-d79f-4b25-a146-1487619f8073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:16.042450 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3a3e7-d79f-4b25-a146-1487619f8073 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:16.042762 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3a3e7-d79f-4b25-a146-1487619f8073 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:16.043092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3a3e7-d79f-4b25-a146-1487619f8073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-029b0809-219b-4d0e-ab4e-72b6145a7f44 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:16.052659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:16.054236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:16.055543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:16.055543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:16.055543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:16.055543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:16.055543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:16.055543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:16.055543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:16.055543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:16.055543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:59:16.055543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:16.055543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 302/616] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:59:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:16.055543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b0809-219b-4d0e-ab4e-72b6145a7f44 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:16.060838 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3a3e7-d79f-4b25-a146-1487619f8073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:16.061876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3a3e7-d79f-4b25-a146-1487619f8073 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-bda3a3e7-d79f-4b25-a146-1487619f8073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:16.078235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:16.079354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:16.080248 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:16.080248 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:16.080248 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:16.080248 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:16.083981 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 315/617] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:16.084817 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3a3e7-d79f-4b25-a146-1487619f8073 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:16.160591 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b0809-219b-4d0e-ab4e-72b6145a7f44 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:16.189296 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3a3e7-d79f-4b25-a146-1487619f8073 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:16.195469 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a73e11-ff6e-45cb-9864-4f0e7baf0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:16.196089 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a73e11-ff6e-45cb-9864-4f0e7baf0de1 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:16.196374 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a73e11-ff6e-45cb-9864-4f0e7baf0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:16.196647 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a73e11-ff6e-45cb-9864-4f0e7baf0de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:16.207895 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:16.208581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:16.230226 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19d10d-2030-4d8d-b914-82b1f1dabf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:16.231487 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d10d-2030-4d8d-b914-82b1f1dabf51 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:16.231772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d10d-2030-4d8d-b914-82b1f1dabf51 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:16.232050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d10d-2030-4d8d-b914-82b1f1dabf51 None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:16.232823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19d10d-2030-4d8d-b914-82b1f1dabf51 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:16.233125 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19d10d-2030-4d8d-b914-82b1f1dabf51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:16.234537 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19d10d-2030-4d8d-b914-82b1f1dabf51 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:16.252933 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 316/618] 10.222.0.65 () {56 vars in 1137 bytes} [Mon Jul 25 23:59:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:16.253737 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19d10d-2030-4d8d-b914-82b1f1dabf51 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:16.274340 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a73e11-ff6e-45cb-9864-4f0e7baf0de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:16.275857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a73e11-ff6e-45cb-9864-4f0e7baf0de1 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:16.364715 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19d10d-2030-4d8d-b914-82b1f1dabf51 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:16.385906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 303/619] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:59:16.387055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a73e11-ff6e-45cb-9864-4f0e7baf0de1 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:16.404468 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d1b43-3007-4b27-b42f-b8df70a8b6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:16.405091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1b43-3007-4b27-b42f-b8df70a8b6e5 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:16.405476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1b43-3007-4b27-b42f-b8df70a8b6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:16.405650 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1b43-3007-4b27-b42f-b8df70a8b6e5 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:16.406330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d1b43-3007-4b27-b42f-b8df70a8b6e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:16.406640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d1b43-3007-4b27-b42f-b8df70a8b6e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:16.408033 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d1b43-3007-4b27-b42f-b8df70a8b6e5 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:16.420144 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 317/620] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:16.420933 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d1b43-3007-4b27-b42f-b8df70a8b6e5 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:16.437092 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:16.462446 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:16.500976 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a73e11-ff6e-45cb-9864-4f0e7baf0de1 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:16.535164 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d1b43-3007-4b27-b42f-b8df70a8b6e5 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:16.539408 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e29ca-3466-409b-bcf0-14012bb9c724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:16.540079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e29ca-3466-409b-bcf0-14012bb9c724 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:16.540364 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e29ca-3466-409b-bcf0-14012bb9c724 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:16.540635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e29ca-3466-409b-bcf0-14012bb9c724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:16.575358 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb8f06-8dfa-4fc2-aca4-39927598202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:16.576004 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb8f06-8dfa-4fc2-aca4-39927598202e None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:16.576282 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb8f06-8dfa-4fc2-aca4-39927598202e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:16.576558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb8f06-8dfa-4fc2-aca4-39927598202e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:16.588816 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb8f06-8dfa-4fc2-aca4-39927598202e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:16.590829 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb8f06-8dfa-4fc2-aca4-39927598202e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-7cbb8f06-8dfa-4fc2-aca4-39927598202e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:16.606297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:16.607244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:16.608158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:16.608158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:16.608158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:16.608158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:16.608158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 318/621] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:16.608448 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb8f06-8dfa-4fc2-aca4-39927598202e None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:16.628972 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e29ca-3466-409b-bcf0-14012bb9c724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:16.630470 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e29ca-3466-409b-bcf0-14012bb9c724 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:16.675650 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:16.700283 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:16.714089 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb8f06-8dfa-4fc2-aca4-39927598202e None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:16.741101 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 304/622] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:59:16.743970 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e29ca-3466-409b-bcf0-14012bb9c724 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:16.752276 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e18d6-94d1-49df-8a21-e390a3ceb257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:16.752843 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e18d6-94d1-49df-8a21-e390a3ceb257 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:16.753117 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e18d6-94d1-49df-8a21-e390a3ceb257 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:16.753811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e18d6-94d1-49df-8a21-e390a3ceb257 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:16.762439 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e18d6-94d1-49df-8a21-e390a3ceb257 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:16.763911 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e18d6-94d1-49df-8a21-e390a3ceb257 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-845e18d6-94d1-49df-8a21-e390a3ceb257 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:16.775746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:16.776667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:16.778275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:16.778275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:16.778275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:16.778275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:16.778275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:16.778275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:16.778275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:16.778275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:16.778275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 23:59:16.778275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:16.782183 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 319/623] 10.222.0.65 () {56 vars in 1102 bytes} [Mon Jul 25 23:59:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:16.783063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e18d6-94d1-49df-8a21-e390a3ceb257 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:16.859266 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e29ca-3466-409b-bcf0-14012bb9c724 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:16.885184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e18d6-94d1-49df-8a21-e390a3ceb257 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:16.896432 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158b8ce-f6d9-4768-93bb-2dcfd1106681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:16.897306 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158b8ce-f6d9-4768-93bb-2dcfd1106681 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:16.897783 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158b8ce-f6d9-4768-93bb-2dcfd1106681 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:16.898360 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158b8ce-f6d9-4768-93bb-2dcfd1106681 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:16.899396 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158b8ce-f6d9-4768-93bb-2dcfd1106681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:16.899882 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158b8ce-f6d9-4768-93bb-2dcfd1106681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:16.901616 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158b8ce-f6d9-4768-93bb-2dcfd1106681 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:16.910685 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:16.920007 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 305/624] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:16.920788 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158b8ce-f6d9-4768-93bb-2dcfd1106681 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:16.921117 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d18aa-a9a6-4852-9e0d-ce91a2b781e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:16.921982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d18aa-a9a6-4852-9e0d-ce91a2b781e8 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:16.922263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d18aa-a9a6-4852-9e0d-ce91a2b781e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:16.922537 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d18aa-a9a6-4852-9e0d-ce91a2b781e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:16.934572 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d18aa-a9a6-4852-9e0d-ce91a2b781e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:16.936054 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d18aa-a9a6-4852-9e0d-ce91a2b781e8 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:16.946566 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-482d18aa-a9a6-4852-9e0d-ce91a2b781e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:16.953775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:16.954892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:16.955976 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:16.955976 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:16.955976 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:16.955976 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:16.957911 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 320/625] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:16.959669 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d18aa-a9a6-4852-9e0d-ce91a2b781e8 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:17.047335 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158b8ce-f6d9-4768-93bb-2dcfd1106681 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:17.077947 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d18aa-a9a6-4852-9e0d-ce91a2b781e8 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:17.082983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65faeb3-bccc-42b5-a1de-e309f1cc3ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:17.083610 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65faeb3-bccc-42b5-a1de-e309f1cc3ba4 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:17.083889 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65faeb3-bccc-42b5-a1de-e309f1cc3ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:17.084164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65faeb3-bccc-42b5-a1de-e309f1cc3ba4 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:17.084952 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65faeb3-bccc-42b5-a1de-e309f1cc3ba4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:17.085260 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65faeb3-bccc-42b5-a1de-e309f1cc3ba4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:17.086697 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65faeb3-bccc-42b5-a1de-e309f1cc3ba4 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:17.105527 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 306/626] 10.222.0.65 () {56 vars in 1139 bytes} [Mon Jul 25 23:59:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:17.110848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65faeb3-bccc-42b5-a1de-e309f1cc3ba4 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:17.113568 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8e9ea-c095-4567-b47e-29dcf945767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:17.114326 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8e9ea-c095-4567-b47e-29dcf945767d None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:17.114604 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8e9ea-c095-4567-b47e-29dcf945767d None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:17.114906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8e9ea-c095-4567-b47e-29dcf945767d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:17.122183 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8e9ea-c095-4567-b47e-29dcf945767d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:17.123826 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8e9ea-c095-4567-b47e-29dcf945767d None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-fdb8e9ea-c095-4567-b47e-29dcf945767d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:17.135968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:17.137676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:17.138807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:17.138807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:17.138807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:17.138807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:17.138807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:17.138807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:17.138807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:17.138807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:17.142801 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 321/627] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:17.143792 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8e9ea-c095-4567-b47e-29dcf945767d None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:17.173334 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:17.204001 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:17.214033 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65faeb3-bccc-42b5-a1de-e309f1cc3ba4 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:17.245158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8e9ea-c095-4567-b47e-29dcf945767d None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:17.247678 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa4024-8e0e-47f5-9890-4e7db4dffbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:17.248318 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa4024-8e0e-47f5-9890-4e7db4dffbb3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:17.248598 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa4024-8e0e-47f5-9890-4e7db4dffbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:17.248873 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa4024-8e0e-47f5-9890-4e7db4dffbb3 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:17.249555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa4024-8e0e-47f5-9890-4e7db4dffbb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:17.249858 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa4024-8e0e-47f5-9890-4e7db4dffbb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:17.251282 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa4024-8e0e-47f5-9890-4e7db4dffbb3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:17.262383 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 307/628] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:17.263203 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa4024-8e0e-47f5-9890-4e7db4dffbb3 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:17.282133 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982329d1-b0d5-4a22-8b7e-d91099164800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:17.282829 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982329d1-b0d5-4a22-8b7e-d91099164800 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:17.283107 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982329d1-b0d5-4a22-8b7e-d91099164800 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:17.283378 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982329d1-b0d5-4a22-8b7e-d91099164800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:17.358265 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982329d1-b0d5-4a22-8b7e-d91099164800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:17.359680 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982329d1-b0d5-4a22-8b7e-d91099164800 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:17.362392 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa4024-8e0e-47f5-9890-4e7db4dffbb3 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:17.379290 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:17.397647 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56493c3-1a71-4791-8807-a6aeb0d06ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:17.398262 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56493c3-1a71-4791-8807-a6aeb0d06ec2 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:17.398541 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56493c3-1a71-4791-8807-a6aeb0d06ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:17.398845 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56493c3-1a71-4791-8807-a6aeb0d06ec2 None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:17.399577 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56493c3-1a71-4791-8807-a6aeb0d06ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:17.399893 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56493c3-1a71-4791-8807-a6aeb0d06ec2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:17.401346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56493c3-1a71-4791-8807-a6aeb0d06ec2 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:17.413596 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 308/629] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:17.414783 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f034867-2446-4529-b786-478abb1d9527 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:17.415133 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f034867-2446-4529-b786-478abb1d9527 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:17.415449 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f034867-2446-4529-b786-478abb1d9527 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:17.416777 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 309/630] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:17.417300 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f034867-2446-4529-b786-478abb1d9527 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:17.418932 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:17.461459 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 322/631] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:59:17.462274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982329d1-b0d5-4a22-8b7e-d91099164800 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:17.522261 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f034867-2446-4529-b786-478abb1d9527 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:17.555404 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da199fd5-46fc-43ff-a8b5-e7590347d07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:17.556034 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da199fd5-46fc-43ff-a8b5-e7590347d07a None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:17.556313 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da199fd5-46fc-43ff-a8b5-e7590347d07a None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:17.556587 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da199fd5-46fc-43ff-a8b5-e7590347d07a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:17.559005 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982329d1-b0d5-4a22-8b7e-d91099164800 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:17.563757 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da199fd5-46fc-43ff-a8b5-e7590347d07a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:17.565200 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da199fd5-46fc-43ff-a8b5-e7590347d07a None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-da199fd5-46fc-43ff-a8b5-e7590347d07a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:17.576916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:17.577950 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:17.578995 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:17.578995 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:17.578995 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:17.578995 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:17.578995 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:17.578995 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:17.578995 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:17.578995 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:17.578995 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 310/632] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:17.579565 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081de8a-9171-4457-b0a0-d0c10f3157db None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:17.579778 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081de8a-9171-4457-b0a0-d0c10f3157db None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:17.580049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081de8a-9171-4457-b0a0-d0c10f3157db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:17.596801 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ed60e-8a6d-485d-b591-1de510239300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:17.597008 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-5081de8a-9171-4457-b0a0-d0c10f3157db None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:17.597422 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ed60e-8a6d-485d-b591-1de510239300 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:17.597685 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ed60e-8a6d-485d-b591-1de510239300 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:17.597959 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ed60e-8a6d-485d-b591-1de510239300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:17.598165 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-5081de8a-9171-4457-b0a0-d0c10f3157db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:17.598747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ed60e-8a6d-485d-b591-1de510239300 None admin] RBAC: Adding query filter params (role.id=6be878a30a464fc38706d4cab9d64f17, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=cbc09289c7e645b189776f109b78968e) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:17.599061 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ed60e-8a6d-485d-b591-1de510239300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:17.600472 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ed60e-8a6d-485d-b591-1de510239300 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:17.606162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 323/633] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:59:17 2022] GET /identity/v3/role_assignments?user.id=cbc09289c7e645b189776f109b78968e&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=6be878a30a464fc38706d4cab9d64f17 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:17.606970 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ed60e-8a6d-485d-b591-1de510239300 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:17.629193 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:17.653248 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:17.675844 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 311/634] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:17.676698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081de8a-9171-4457-b0a0-d0c10f3157db None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:17.753172 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ed60e-8a6d-485d-b591-1de510239300 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:17.790419 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c65dc-31d0-49b8-84eb-e157ca8b253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:17.791160 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c65dc-31d0-49b8-84eb-e157ca8b253b None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:17.791888 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c65dc-31d0-49b8-84eb-e157ca8b253b None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:17.791888 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c65dc-31d0-49b8-84eb-e157ca8b253b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:17.794364 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081de8a-9171-4457-b0a0-d0c10f3157db None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:17.805910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c65dc-31d0-49b8-84eb-e157ca8b253b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:17.807409 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c65dc-31d0-49b8-84eb-e157ca8b253b None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-338c65dc-31d0-49b8-84eb-e157ca8b253b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:17.824405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:17.825320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:17.826442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:17.826442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:17.826442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:17.826442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:17.830741 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 324/635] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:17.831209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c65dc-31d0-49b8-84eb-e157ca8b253b None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:17.838261 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd4b6b-940e-4845-b25a-c22c681af404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:17.838907 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd4b6b-940e-4845-b25a-c22c681af404 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:17.839192 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd4b6b-940e-4845-b25a-c22c681af404 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:17.839468 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd4b6b-940e-4845-b25a-c22c681af404 None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:17.840269 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd4b6b-940e-4845-b25a-c22c681af404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:17.840581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd4b6b-940e-4845-b25a-c22c681af404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:17.842020 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd4b6b-940e-4845-b25a-c22c681af404 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:17.855015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 312/636] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:17.856396 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd4b6b-940e-4845-b25a-c22c681af404 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:17.888894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:17.924316 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:17.950774 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c65dc-31d0-49b8-84eb-e157ca8b253b None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:17.963123 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd4b6b-940e-4845-b25a-c22c681af404 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:17.995126 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93e560-59c4-4915-8f4a-190ba8e77537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:17.996537 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93e560-59c4-4915-8f4a-190ba8e77537 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:17.997020 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93e560-59c4-4915-8f4a-190ba8e77537 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:17.997469 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93e560-59c4-4915-8f4a-190ba8e77537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:18.005023 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cc5ce-1713-470d-b3be-466069cb2824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:18.005635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cc5ce-1713-470d-b3be-466069cb2824 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:18.005939 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cc5ce-1713-470d-b3be-466069cb2824 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:18.006194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cc5ce-1713-470d-b3be-466069cb2824 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:18.006920 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cc5ce-1713-470d-b3be-466069cb2824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:18.007229 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cc5ce-1713-470d-b3be-466069cb2824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:18.008602 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cc5ce-1713-470d-b3be-466069cb2824 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:18.009624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93e560-59c4-4915-8f4a-190ba8e77537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-0c93e560-59c4-4915-8f4a-190ba8e77537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:18.015897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:18.016810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:18.017624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 325/637] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:18.018330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93e560-59c4-4915-8f4a-190ba8e77537 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:18.032046 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 313/638] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:18.032046 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cc5ce-1713-470d-b3be-466069cb2824 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:18.126146 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:18.136296 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93e560-59c4-4915-8f4a-190ba8e77537 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:18.141637 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cc5ce-1713-470d-b3be-466069cb2824 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:18.172082 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d1955-53fe-4768-b21e-a163c090fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:18.172692 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d1955-53fe-4768-b21e-a163c090fea8 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:18.172970 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d1955-53fe-4768-b21e-a163c090fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:18.173241 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d1955-53fe-4768-b21e-a163c090fea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:18.174017 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d1955-53fe-4768-b21e-a163c090fea8 None admin] RBAC: Adding query filter params (role.id=6be878a30a464fc38706d4cab9d64f17, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=5f8a981708a34de5be7cda18eb8bb1a3) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:18.174323 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d1955-53fe-4768-b21e-a163c090fea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:18.175795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d1955-53fe-4768-b21e-a163c090fea8 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:18.179082 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:18.183098 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 326/639] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:59:18 2022] GET /identity/v3/role_assignments?user.id=5f8a981708a34de5be7cda18eb8bb1a3&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=6be878a30a464fc38706d4cab9d64f17 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:18.184673 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d1955-53fe-4768-b21e-a163c090fea8 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:18.195637 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d500e-002f-4d20-9160-98d081d35c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:18.206738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d500e-002f-4d20-9160-98d081d35c5b None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:18.206738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d500e-002f-4d20-9160-98d081d35c5b None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:18.206738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d500e-002f-4d20-9160-98d081d35c5b None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:18.206738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d500e-002f-4d20-9160-98d081d35c5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:18.206738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d500e-002f-4d20-9160-98d081d35c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:18.206738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d500e-002f-4d20-9160-98d081d35c5b None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:18.214087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 314/640] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:18.215944 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d500e-002f-4d20-9160-98d081d35c5b None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:18.315241 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d1955-53fe-4768-b21e-a163c090fea8 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:18.351356 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d500e-002f-4d20-9160-98d081d35c5b None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:18.371795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc25b-3359-40b1-9bc2-dbb21bb30613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:18.372208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc25b-3359-40b1-9bc2-dbb21bb30613 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:18.372539 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc25b-3359-40b1-9bc2-dbb21bb30613 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:18.372785 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc25b-3359-40b1-9bc2-dbb21bb30613 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:18.380589 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fc25b-3359-40b1-9bc2-dbb21bb30613 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:18.382801 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fc25b-3359-40b1-9bc2-dbb21bb30613 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-187fc25b-3359-40b1-9bc2-dbb21bb30613 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:18.403201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:18.404527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:18.405729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:18.405729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:18.405729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:18.405729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:18.405729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:18.405729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:18.405729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:18.405729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:18.406286 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b01b84-bd95-4501-97e2-ee5490b6c3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:18.406286 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b01b84-bd95-4501-97e2-ee5490b6c3a0 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:18.406286 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b01b84-bd95-4501-97e2-ee5490b6c3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:18.406286 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b01b84-bd95-4501-97e2-ee5490b6c3a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:18.408571 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 327/641] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:18.414396 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc25b-3359-40b1-9bc2-dbb21bb30613 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:18.422843 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b01b84-bd95-4501-97e2-ee5490b6c3a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:18.424336 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b01b84-bd95-4501-97e2-ee5490b6c3a0 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-96b01b84-bd95-4501-97e2-ee5490b6c3a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:18.442892 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:18.443832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:18.444738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:18.444738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:18.444738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:18.444738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:18.444738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 315/642] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:18.450636 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b01b84-bd95-4501-97e2-ee5490b6c3a0 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:18.453502 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:18.499098 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:18.554500 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc25b-3359-40b1-9bc2-dbb21bb30613 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:18.591463 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b01b84-bd95-4501-97e2-ee5490b6c3a0 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:18.592061 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b58f5-ed60-4386-bb95-97e4366a0145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:18.592691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b58f5-ed60-4386-bb95-97e4366a0145 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:18.592971 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b58f5-ed60-4386-bb95-97e4366a0145 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:18.593245 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b58f5-ed60-4386-bb95-97e4366a0145 None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:18.593984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b58f5-ed60-4386-bb95-97e4366a0145 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:18.594292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b58f5-ed60-4386-bb95-97e4366a0145 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:18.596221 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b58f5-ed60-4386-bb95-97e4366a0145 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:18.609313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 328/643] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:18.614650 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b58f5-ed60-4386-bb95-97e4366a0145 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:18.637952 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047aa6c-d1cb-4b1c-a53d-27d026b5c4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:18.639433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047aa6c-d1cb-4b1c-a53d-27d026b5c4c7 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:18.640174 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047aa6c-d1cb-4b1c-a53d-27d026b5c4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:18.640610 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047aa6c-d1cb-4b1c-a53d-27d026b5c4c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:18.641705 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047aa6c-d1cb-4b1c-a53d-27d026b5c4c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:18.642588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047aa6c-d1cb-4b1c-a53d-27d026b5c4c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:18.644768 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047aa6c-d1cb-4b1c-a53d-27d026b5c4c7 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:18.661693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 316/644] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:18.667629 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047aa6c-d1cb-4b1c-a53d-27d026b5c4c7 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:18.740081 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b58f5-ed60-4386-bb95-97e4366a0145 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:18.747087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:18.775496 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:18.785646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc735-8e5b-4d80-8baf-c0f25725d099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:18.786431 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc735-8e5b-4d80-8baf-c0f25725d099 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:18.786852 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc735-8e5b-4d80-8baf-c0f25725d099 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:18.787234 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cc735-8e5b-4d80-8baf-c0f25725d099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:18.788123 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc735-8e5b-4d80-8baf-c0f25725d099 None admin] RBAC: Adding query filter params (role.id=6be878a30a464fc38706d4cab9d64f17, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=d4e34b7f817f452faabd2d32d1af3ab8) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:18.788544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc735-8e5b-4d80-8baf-c0f25725d099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:18.790080 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cc735-8e5b-4d80-8baf-c0f25725d099 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:18.796298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047aa6c-d1cb-4b1c-a53d-27d026b5c4c7 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:18.796920 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 329/645] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:59:18 2022] GET /identity/v3/role_assignments?user.id=d4e34b7f817f452faabd2d32d1af3ab8&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=6be878a30a464fc38706d4cab9d64f17 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:18.837516 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a66fa0-6ac3-44f9-9f29-0d6b29f7ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:18.838183 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a66fa0-6ac3-44f9-9f29-0d6b29f7ae15 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:18.838464 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a66fa0-6ac3-44f9-9f29-0d6b29f7ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:18.838834 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a66fa0-6ac3-44f9-9f29-0d6b29f7ae15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:18.848114 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a66fa0-6ac3-44f9-9f29-0d6b29f7ae15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:18.849723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a66fa0-6ac3-44f9-9f29-0d6b29f7ae15 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-e3a66fa0-6ac3-44f9-9f29-0d6b29f7ae15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:18.863555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:18.864631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:18.865588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:18.865588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:18.865588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:18.865588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:18.865588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:18.865588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:18.865588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:18.865588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:18.865588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:59:18.865588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:18.865588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 317/646] 10.222.0.65 () {56 vars in 1093 bytes} [Mon Jul 25 23:59:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:18.872559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc735-8e5b-4d80-8baf-c0f25725d099 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:18.986241 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cc735-8e5b-4d80-8baf-c0f25725d099 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:19.022530 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c9fc4-a4e3-480c-bad7-2d8142d113d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:19.023188 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c9fc4-a4e3-480c-bad7-2d8142d113d0 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:19.023464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c9fc4-a4e3-480c-bad7-2d8142d113d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:19.023736 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c9fc4-a4e3-480c-bad7-2d8142d113d0 None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:19.024539 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c9fc4-a4e3-480c-bad7-2d8142d113d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:19.024831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c9fc4-a4e3-480c-bad7-2d8142d113d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:19.026283 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c9fc4-a4e3-480c-bad7-2d8142d113d0 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:19.045821 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 330/647] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Jul 25 23:59:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:19.051414 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a66fa0-6ac3-44f9-9f29-0d6b29f7ae15 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:19.158803 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a66fa0-6ac3-44f9-9f29-0d6b29f7ae15 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:19.183730 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:19.195853 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c427f-8921-4e80-81b4-850120c44ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:19.196526 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c427f-8921-4e80-81b4-850120c44ded None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:19.196807 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c427f-8921-4e80-81b4-850120c44ded None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:19.197080 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c427f-8921-4e80-81b4-850120c44ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:19.267541 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c427f-8921-4e80-81b4-850120c44ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:19.268910 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c427f-8921-4e80-81b4-850120c44ded None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:19.378305 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 318/648] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 23:59:19.388067 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c9fc4-a4e3-480c-bad7-2d8142d113d0 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:19.435986 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:19.497393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c9fc4-a4e3-480c-bad7-2d8142d113d0 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:19.533145 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83693934-f0c4-4c77-8048-9c17acc981ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:19.533767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83693934-f0c4-4c77-8048-9c17acc981ca None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:19.534046 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83693934-f0c4-4c77-8048-9c17acc981ca None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:19.534320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83693934-f0c4-4c77-8048-9c17acc981ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:19.545681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83693934-f0c4-4c77-8048-9c17acc981ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:19.547251 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83693934-f0c4-4c77-8048-9c17acc981ca None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-83693934-f0c4-4c77-8048-9c17acc981ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:19.562861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:19.563760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:19.564634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:19.564634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:19.564634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:19.564634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:19.564634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 331/649] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:19.571077 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c427f-8921-4e80-81b4-850120c44ded None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:19.596835 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:19.678113 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c427f-8921-4e80-81b4-850120c44ded None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:19.715489 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01f1ac-5509-4acd-bfa6-1e879ad8cd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:19.716110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01f1ac-5509-4acd-bfa6-1e879ad8cd1d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:19.716387 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01f1ac-5509-4acd-bfa6-1e879ad8cd1d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:19.716658 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01f1ac-5509-4acd-bfa6-1e879ad8cd1d None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:19.717341 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01f1ac-5509-4acd-bfa6-1e879ad8cd1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:19.717642 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01f1ac-5509-4acd-bfa6-1e879ad8cd1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:19.719032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01f1ac-5509-4acd-bfa6-1e879ad8cd1d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:19.731352 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 319/650] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:19.736858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83693934-f0c4-4c77-8048-9c17acc981ca None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:19.838065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:19.845949 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83693934-f0c4-4c77-8048-9c17acc981ca None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:19.883147 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b5357-ed6f-41c6-8b8b-94c2af25e729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:19.883787 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5357-ed6f-41c6-8b8b-94c2af25e729 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:19.884066 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5357-ed6f-41c6-8b8b-94c2af25e729 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:19.884341 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5357-ed6f-41c6-8b8b-94c2af25e729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:19.892093 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5357-ed6f-41c6-8b8b-94c2af25e729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:19.893539 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5357-ed6f-41c6-8b8b-94c2af25e729 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-071b5357-ed6f-41c6-8b8b-94c2af25e729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:19.905049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:19.905978 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:19.906921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:19.906921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:19.906921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:19.906921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:19.906921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:19.906921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:19.906921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:19.906921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:19.906921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 332/651] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:19.913781 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01f1ac-5509-4acd-bfa6-1e879ad8cd1d None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:19.994867 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715d76d-5619-45de-9fa7-d3c92fbd7475 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:19.995161 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715d76d-5619-45de-9fa7-d3c92fbd7475 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:19.995441 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715d76d-5619-45de-9fa7-d3c92fbd7475 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:19.997681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 333/652] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:20.002800 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c49ad6-e9a4-40e9-b216-f96079abc9a5 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:20.003091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c49ad6-e9a4-40e9-b216-f96079abc9a5 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:20.003377 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c49ad6-e9a4-40e9-b216-f96079abc9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:20.006423 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:20.025179 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-f4c49ad6-e9a4-40e9-b216-f96079abc9a5 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:20.026841 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-f4c49ad6-e9a4-40e9-b216-f96079abc9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:20.032358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01f1ac-5509-4acd-bfa6-1e879ad8cd1d None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:20.074992 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668919-f853-47b4-a97b-cafa82ba2a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:20.075615 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668919-f853-47b4-a97b-cafa82ba2a5b None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:20.075897 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668919-f853-47b4-a97b-cafa82ba2a5b None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:20.076176 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668919-f853-47b4-a97b-cafa82ba2a5b None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:20.077293 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668919-f853-47b4-a97b-cafa82ba2a5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:20.077605 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668919-f853-47b4-a97b-cafa82ba2a5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:20.079615 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668919-f853-47b4-a97b-cafa82ba2a5b None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:20.096418 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 320/653] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:20.102632 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668919-f853-47b4-a97b-cafa82ba2a5b None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:20.118938 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 334/654] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:59:20.139713 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c49ad6-e9a4-40e9-b216-f96079abc9a5 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:20.231601 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668919-f853-47b4-a97b-cafa82ba2a5b None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:20.237229 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:20.256483 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c49ad6-e9a4-40e9-b216-f96079abc9a5 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:20.273782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263b885-f261-42ef-9040-7caaf8acc121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:20.274640 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b885-f261-42ef-9040-7caaf8acc121 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:20.274955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b885-f261-42ef-9040-7caaf8acc121 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:20.275233 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b885-f261-42ef-9040-7caaf8acc121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:20.276020 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263b885-f261-42ef-9040-7caaf8acc121 None admin] RBAC: Adding query filter params (role.id=5d947b934e0642c5a4ab00d547ec3fda, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=a513753b2f49408baf24402f1fa3c7e9) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:20.276328 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263b885-f261-42ef-9040-7caaf8acc121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:20.279015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263b885-f261-42ef-9040-7caaf8acc121 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:20.290746 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 321/655] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:59:20 2022] GET /identity/v3/role_assignments?user.id=a513753b2f49408baf24402f1fa3c7e9&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=5d947b934e0642c5a4ab00d547ec3fda => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:20.297748 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812f2f4-3553-4296-b69a-7a7580db0668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:20.298418 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f2f4-3553-4296-b69a-7a7580db0668 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:20.298746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f2f4-3553-4296-b69a-7a7580db0668 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:20.299018 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f2f4-3553-4296-b69a-7a7580db0668 None admin] PATH_INFO: `/v3/services/image` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:20.299655 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812f2f4-3553-4296-b69a-7a7580db0668 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:20.301189 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812f2f4-3553-4296-b69a-7a7580db0668 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-2812f2f4-3553-4296-b69a-7a7580db0668 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:20.313825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:20.315063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:20.315917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 335/656] 10.222.0.65 () {56 vars in 1105 bytes} [Mon Jul 25 23:59:20 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:59:20.323269 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263b885-f261-42ef-9040-7caaf8acc121 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:20.344269 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:20.439893 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263b885-f261-42ef-9040-7caaf8acc121 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:20.478046 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057147e3-15b8-4a78-afcc-569375b3693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:20.478654 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057147e3-15b8-4a78-afcc-569375b3693c None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:20.478968 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057147e3-15b8-4a78-afcc-569375b3693c None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:20.479242 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057147e3-15b8-4a78-afcc-569375b3693c None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:20.479922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057147e3-15b8-4a78-afcc-569375b3693c None admin] RBAC: Adding query filter params (name=image) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:20.480947 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057147e3-15b8-4a78-afcc-569375b3693c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:20.482479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057147e3-15b8-4a78-afcc-569375b3693c None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:20.488542 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 322/657] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:20.493802 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812f2f4-3553-4296-b69a-7a7580db0668 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:20.580753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9c210-e7c0-46f5-bf4d-895d11c639ea None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:20.581105 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9c210-e7c0-46f5-bf4d-895d11c639ea None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:20.581333 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9c210-e7c0-46f5-bf4d-895d11c639ea None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:20.583577 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 323/658] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:59:20.588616 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c5134-21f7-4d31-b114-4418907c7210 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:20.588899 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c5134-21f7-4d31-b114-4418907c7210 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:20.589179 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c5134-21f7-4d31-b114-4418907c7210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:20.608653 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-459c5134-21f7-4d31-b114-4418907c7210 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:20.609859 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-459c5134-21f7-4d31-b114-4418907c7210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:20.610152 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812f2f4-3553-4296-b69a-7a7580db0668 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:20.654570 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a415a9-7899-40af-94cc-a7598fe103d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:20.656412 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a415a9-7899-40af-94cc-a7598fe103d3 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:20.656847 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a415a9-7899-40af-94cc-a7598fe103d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:20.657279 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a415a9-7899-40af-94cc-a7598fe103d3 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:20.658112 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a415a9-7899-40af-94cc-a7598fe103d3 None admin] RBAC: Adding query filter params (type=image) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:20.658566 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a415a9-7899-40af-94cc-a7598fe103d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:20.660166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a415a9-7899-40af-94cc-a7598fe103d3 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:20.669797 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 336/659] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:20.692235 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:20.699406 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 324/660] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:59:20.722604 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a415a9-7899-40af-94cc-a7598fe103d3 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:20.745323 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:20.847096 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a415a9-7899-40af-94cc-a7598fe103d3 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:20.883567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be417caa-ec18-4e24-9ee4-6f4a1462d7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:20.884211 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be417caa-ec18-4e24-9ee4-6f4a1462d7cd None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:20.884493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be417caa-ec18-4e24-9ee4-6f4a1462d7cd None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:20.884770 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be417caa-ec18-4e24-9ee4-6f4a1462d7cd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:20.885392 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be417caa-ec18-4e24-9ee4-6f4a1462d7cd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:20.887493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be417caa-ec18-4e24-9ee4-6f4a1462d7cd None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-be417caa-ec18-4e24-9ee4-6f4a1462d7cd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:20.896982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:20.897914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:20.898767 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 337/661] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Jul 25 23:59:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:20.905018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c5134-21f7-4d31-b114-4418907c7210 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:21.013512 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c5134-21f7-4d31-b114-4418907c7210 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:21.049395 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e4222-6444-4fe5-811a-dff04fff52a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:21.050065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e4222-6444-4fe5-811a-dff04fff52a1 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:21.050302 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e4222-6444-4fe5-811a-dff04fff52a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:21.050580 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e4222-6444-4fe5-811a-dff04fff52a1 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:21.051288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e4222-6444-4fe5-811a-dff04fff52a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:21.051595 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e4222-6444-4fe5-811a-dff04fff52a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:21.052977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e4222-6444-4fe5-811a-dff04fff52a1 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:21.057963 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 325/662] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Jul 25 23:59:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:21.063802 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be417caa-ec18-4e24-9ee4-6f4a1462d7cd None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:21.150104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:21.186216 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be417caa-ec18-4e24-9ee4-6f4a1462d7cd None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:21.222532 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f661c8-4ba6-4b1f-8d5d-11d48bfbd890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:21.223177 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f661c8-4ba6-4b1f-8d5d-11d48bfbd890 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:21.223457 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f661c8-4ba6-4b1f-8d5d-11d48bfbd890 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:21.223729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f661c8-4ba6-4b1f-8d5d-11d48bfbd890 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:21.224389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f661c8-4ba6-4b1f-8d5d-11d48bfbd890 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:21.224690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f661c8-4ba6-4b1f-8d5d-11d48bfbd890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:21.226044 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f661c8-4ba6-4b1f-8d5d-11d48bfbd890 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:21.234910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 338/663] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Jul 25 23:59:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:21.317659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da978e80-d4b5-4077-992c-929c7a151400 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:21.318219 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da978e80-d4b5-4077-992c-929c7a151400 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:21.318219 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da978e80-d4b5-4077-992c-929c7a151400 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:21.319882 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 326/664] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:21.325467 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87867a18-200a-46af-922d-6049b7df51d1 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:21.325777 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87867a18-200a-46af-922d-6049b7df51d1 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:21.326023 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87867a18-200a-46af-922d-6049b7df51d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:21.346272 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-87867a18-200a-46af-922d-6049b7df51d1 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:21.347527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-87867a18-200a-46af-922d-6049b7df51d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:21.424072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 339/665] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:59:21.447407 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da978e80-d4b5-4077-992c-929c7a151400 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:21.526102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:21.569187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da978e80-d4b5-4077-992c-929c7a151400 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:21.606966 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2e4c0-e860-41b5-95bf-6139570c6b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:21.607847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2e4c0-e860-41b5-95bf-6139570c6b73 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:21.608270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2e4c0-e860-41b5-95bf-6139570c6b73 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:21.608710 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2e4c0-e860-41b5-95bf-6139570c6b73 None admin] PATH_INFO: `/v3/services/network` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:21.609486 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2e4c0-e860-41b5-95bf-6139570c6b73 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:21.611017 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2e4c0-e860-41b5-95bf-6139570c6b73 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-13e2e4c0-e860-41b5-95bf-6139570c6b73 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:21.624277 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:21.625511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:59:21.626534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:21.628246 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 327/666] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:21 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:21.639805 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87867a18-200a-46af-922d-6049b7df51d1 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:21.714068 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:21.745911 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87867a18-200a-46af-922d-6049b7df51d1 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:21.780811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5f25f-5a7f-4526-8cc5-d922e134a8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:21.781429 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f25f-5a7f-4526-8cc5-d922e134a8fd None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:21.781712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f25f-5a7f-4526-8cc5-d922e134a8fd None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:21.781984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f25f-5a7f-4526-8cc5-d922e134a8fd None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:21.782736 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5f25f-5a7f-4526-8cc5-d922e134a8fd None admin] RBAC: Adding query filter params (name=network) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:21.783050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5f25f-5a7f-4526-8cc5-d922e134a8fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:21.784418 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5f25f-5a7f-4526-8cc5-d922e134a8fd None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:21.789251 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 340/667] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:21.794680 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2e4c0-e860-41b5-95bf-6139570c6b73 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:21.903421 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2e4c0-e860-41b5-95bf-6139570c6b73 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:21.932387 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:21.944095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d985-546e-40f4-addd-1642efa5902b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:21.944717 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d985-546e-40f4-addd-1642efa5902b None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:21.944994 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d985-546e-40f4-addd-1642efa5902b None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:21.945267 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d985-546e-40f4-addd-1642efa5902b None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:21.945943 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4d985-546e-40f4-addd-1642efa5902b None admin] RBAC: Adding query filter params (type=network) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:21.946243 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4d985-546e-40f4-addd-1642efa5902b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:21.947658 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4d985-546e-40f4-addd-1642efa5902b None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:21.954062 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 328/668] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:22.677491 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596aefe-05c9-4d80-85c9-2983a9b5a532 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:22.678046 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596aefe-05c9-4d80-85c9-2983a9b5a532 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:22.678046 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596aefe-05c9-4d80-85c9-2983a9b5a532 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:22.679905 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 341/669] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:22.685850 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96086-1162-42f7-a00f-3ac37f822a20 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:22.686662 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96086-1162-42f7-a00f-3ac37f822a20 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:22.687265 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96086-1162-42f7-a00f-3ac37f822a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:22.707603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-4ab96086-1162-42f7-a00f-3ac37f822a20 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:22.709123 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-4ab96086-1162-42f7-a00f-3ac37f822a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:22.782816 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 329/670] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:22.802628 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596aefe-05c9-4d80-85c9-2983a9b5a532 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:22.919316 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596aefe-05c9-4d80-85c9-2983a9b5a532 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:22.956266 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da257fdd-c08f-425f-9093-b2906057e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:22.956820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da257fdd-c08f-425f-9093-b2906057e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:22.957097 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da257fdd-c08f-425f-9093-b2906057e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:22.957368 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da257fdd-c08f-425f-9093-b2906057e1a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:22.959354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:22.971402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da257fdd-c08f-425f-9093-b2906057e1a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-da257fdd-c08f-425f-9093-b2906057e1a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:22.976360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:22.977292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:22.978524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 342/671] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:22.992078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab96086-1162-42f7-a00f-3ac37f822a20 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:23.061091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d4446-2df9-4287-8408-9d182e542b7d None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:23.061401 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d4446-2df9-4287-8408-9d182e542b7d None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:23.061659 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d4446-2df9-4287-8408-9d182e542b7d None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:23.063324 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 343/672] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:59:23.068156 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fa8db-6786-4bf9-ad3e-bb48e945d2be None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:23.068446 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fa8db-6786-4bf9-ad3e-bb48e945d2be None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:23.068730 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fa8db-6786-4bf9-ad3e-bb48e945d2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:23.087579 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-951fa8db-6786-4bf9-ad3e-bb48e945d2be None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:23.088998 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-951fa8db-6786-4bf9-ad3e-bb48e945d2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:23.097804 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab96086-1162-42f7-a00f-3ac37f822a20 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:23.130692 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:23.144281 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554edf3d-3407-4ca4-813a-ca213e77444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:23.144906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554edf3d-3407-4ca4-813a-ca213e77444d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:23.145189 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554edf3d-3407-4ca4-813a-ca213e77444d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:23.145467 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554edf3d-3407-4ca4-813a-ca213e77444d None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:23.146176 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554edf3d-3407-4ca4-813a-ca213e77444d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:23.146480 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554edf3d-3407-4ca4-813a-ca213e77444d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:23.148154 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554edf3d-3407-4ca4-813a-ca213e77444d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:23.157470 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 330/673] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:23.163706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554edf3d-3407-4ca4-813a-ca213e77444d None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:23.182815 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 344/674] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:59:23.206663 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fa8db-6786-4bf9-ad3e-bb48e945d2be None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:23.310407 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554edf3d-3407-4ca4-813a-ca213e77444d None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:23.312730 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fa8db-6786-4bf9-ad3e-bb48e945d2be None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:23.338397 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:23.352288 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc158e5f-198c-45c0-b570-67bf1a3db41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:23.352916 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc158e5f-198c-45c0-b570-67bf1a3db41f None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:23.353203 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc158e5f-198c-45c0-b570-67bf1a3db41f None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:23.353477 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc158e5f-198c-45c0-b570-67bf1a3db41f None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:23.354183 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc158e5f-198c-45c0-b570-67bf1a3db41f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:23.355908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc158e5f-198c-45c0-b570-67bf1a3db41f None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:23.357188 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fab197-6b97-4658-af60-4ad1ddd48d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:23.357989 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fab197-6b97-4658-af60-4ad1ddd48d52 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:23.358414 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fab197-6b97-4658-af60-4ad1ddd48d52 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:23.358879 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fab197-6b97-4658-af60-4ad1ddd48d52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:23.374147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fab197-6b97-4658-af60-4ad1ddd48d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:23.376147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fab197-6b97-4658-af60-4ad1ddd48d52 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:23.378860 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 345/675] 10.222.0.65 () {60 vars in 1141 bytes} [Mon Jul 25 23:59:23 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-23fab197-6b97-4658-af60-4ad1ddd48d52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:23.398590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:23.399782 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:23.400742 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:23.400742 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:23.400742 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:23.400742 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:23.408400 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 331/676] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:23.410148 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc158e5f-198c-45c0-b570-67bf1a3db41f None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:23.546449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc158e5f-198c-45c0-b570-67bf1a3db41f None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:23.585512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ed110-6d4b-4d51-a8b0-c82fbdb1178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:23.586139 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ed110-6d4b-4d51-a8b0-c82fbdb1178e None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:23.586679 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ed110-6d4b-4d51-a8b0-c82fbdb1178e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:23.588077 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce94c9-2e1d-46e1-8d23-9cfae84191a4 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:23.588358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce94c9-2e1d-46e1-8d23-9cfae84191a4 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:23.588635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce94c9-2e1d-46e1-8d23-9cfae84191a4 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:23.590507 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 332/677] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:59:23.590868 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ed110-6d4b-4d51-a8b0-c82fbdb1178e None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:23.591605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ed110-6d4b-4d51-a8b0-c82fbdb1178e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:23.591973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ed110-6d4b-4d51-a8b0-c82fbdb1178e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:23.593375 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ed110-6d4b-4d51-a8b0-c82fbdb1178e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:23.596747 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4368e-8de9-4f80-bf1e-5e208456ea92 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:23.597040 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4368e-8de9-4f80-bf1e-5e208456ea92 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:23.597325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4368e-8de9-4f80-bf1e-5e208456ea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:23.606926 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 346/678] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:23.612308 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ed110-6d4b-4d51-a8b0-c82fbdb1178e None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:23.619801 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-56f4368e-8de9-4f80-bf1e-5e208456ea92 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:23.622756 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-56f4368e-8de9-4f80-bf1e-5e208456ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:23.663093 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:23.665630 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:23.713725 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 333/679] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:23 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 23:59:23.732690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ed110-6d4b-4d51-a8b0-c82fbdb1178e None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:23.739740 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4368e-8de9-4f80-bf1e-5e208456ea92 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:23.769564 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7f10d-0e71-45c4-a526-e06a5b2a3691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:23.770297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7f10d-0e71-45c4-a526-e06a5b2a3691 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:23.770649 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7f10d-0e71-45c4-a526-e06a5b2a3691 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:23.771026 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7f10d-0e71-45c4-a526-e06a5b2a3691 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:23.779618 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7f10d-0e71-45c4-a526-e06a5b2a3691 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:23.781174 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7f10d-0e71-45c4-a526-e06a5b2a3691 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-5fd7f10d-0e71-45c4-a526-e06a5b2a3691 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:23.794092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:23.795134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:23.796076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:23.796076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:23.796076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:23.796076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:23.796076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:23.796076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:23.796076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:23.796076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:23.796076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:59:23.796076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:23.796076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 347/680] 10.222.0.65 () {56 vars in 1093 bytes} [Mon Jul 25 23:59:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:23.800886 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7f10d-0e71-45c4-a526-e06a5b2a3691 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:23.858164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4368e-8de9-4f80-bf1e-5e208456ea92 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:23.894414 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dc04-a329-4224-b5f0-c4d02b29aa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:23.895108 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dc04-a329-4224-b5f0-c4d02b29aa01 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:23.895393 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dc04-a329-4224-b5f0-c4d02b29aa01 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:23.895671 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dc04-a329-4224-b5f0-c4d02b29aa01 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:23.896453 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dc04-a329-4224-b5f0-c4d02b29aa01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:23.897756 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dc04-a329-4224-b5f0-c4d02b29aa01 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:23.923195 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 334/681] 10.222.0.65 () {60 vars in 1141 bytes} [Mon Jul 25 23:59:23 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:59:23.932284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:23.938743 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7f10d-0e71-45c4-a526-e06a5b2a3691 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:23.989822 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9551e89-55fb-47e4-999e-931c5a757605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:23.990778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9551e89-55fb-47e4-999e-931c5a757605 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:23.991276 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9551e89-55fb-47e4-999e-931c5a757605 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:23.991748 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9551e89-55fb-47e4-999e-931c5a757605 None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:23.992821 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9551e89-55fb-47e4-999e-931c5a757605 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:23.993360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9551e89-55fb-47e4-999e-931c5a757605 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:23.995128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9551e89-55fb-47e4-999e-931c5a757605 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:24.021624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 348/682] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Jul 25 23:59:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:24.023819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dc04-a329-4224-b5f0-c4d02b29aa01 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:24.069314 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:24.148732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dc04-a329-4224-b5f0-c4d02b29aa01 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:24.189008 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14b2af-e9a5-4ade-b5ba-575f8ea94da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:24.189645 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14b2af-e9a5-4ade-b5ba-575f8ea94da1 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:24.189927 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14b2af-e9a5-4ade-b5ba-575f8ea94da1 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:24.190205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14b2af-e9a5-4ade-b5ba-575f8ea94da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:24.201099 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14b2af-e9a5-4ade-b5ba-575f8ea94da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:24.202566 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14b2af-e9a5-4ade-b5ba-575f8ea94da1 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-cb14b2af-e9a5-4ade-b5ba-575f8ea94da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:24.218173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:24.219116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:24.220143 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:24.220143 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:24.220143 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:24.220143 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:24.220143 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 335/683] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:24.226828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9551e89-55fb-47e4-999e-931c5a757605 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:24.322690 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbb51c-0950-4e58-9676-3046a6dba80c None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:24.323031 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbb51c-0950-4e58-9676-3046a6dba80c None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:24.323214 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbb51c-0950-4e58-9676-3046a6dba80c None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:24.325361 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 336/684] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:24.330226 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3976ff-ab5c-4df7-a3cf-a9f5ce32ac80 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:24.330488 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3976ff-ab5c-4df7-a3cf-a9f5ce32ac80 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:24.330791 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3976ff-ab5c-4df7-a3cf-a9f5ce32ac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:24.332909 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9551e89-55fb-47e4-999e-931c5a757605 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:24.348839 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-3e3976ff-ab5c-4df7-a3cf-a9f5ce32ac80 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:24.350009 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-3e3976ff-ab5c-4df7-a3cf-a9f5ce32ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:24.379300 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6a489-6a77-4a1a-b085-30574395c4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:24.380374 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6a489-6a77-4a1a-b085-30574395c4ee None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:24.380958 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6a489-6a77-4a1a-b085-30574395c4ee None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:24.381428 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6a489-6a77-4a1a-b085-30574395c4ee None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:24.382441 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6a489-6a77-4a1a-b085-30574395c4ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:24.383045 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6a489-6a77-4a1a-b085-30574395c4ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:24.384726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6a489-6a77-4a1a-b085-30574395c4ee None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:24.402027 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 349/685] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:24.403562 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6a489-6a77-4a1a-b085-30574395c4ee None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:24.426793 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 337/686] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:24 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 23:59:24.431062 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:24.447171 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3976ff-ab5c-4df7-a3cf-a9f5ce32ac80 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:24.457952 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:24.521043 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6a489-6a77-4a1a-b085-30574395c4ee None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:24.562003 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3976ff-ab5c-4df7-a3cf-a9f5ce32ac80 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:24.566208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e1618-238d-4631-a6b5-8fea57a65e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:24.566939 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e1618-238d-4631-a6b5-8fea57a65e37 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:24.567407 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e1618-238d-4631-a6b5-8fea57a65e37 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:24.567689 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e1618-238d-4631-a6b5-8fea57a65e37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:24.578021 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e1618-238d-4631-a6b5-8fea57a65e37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:24.579430 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e1618-238d-4631-a6b5-8fea57a65e37 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-f70e1618-238d-4631-a6b5-8fea57a65e37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:24.592009 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:24.592936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:24.593811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:24.593811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:24.593811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:24.593811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:24.593811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:24.593811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:24.593811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:24.593811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:24.593811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 350/687] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:59:24.598993 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e1618-238d-4631-a6b5-8fea57a65e37 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:24.610674 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ce13d-529b-4f05-a539-b60595d52193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:24.611709 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce13d-529b-4f05-a539-b60595d52193 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:24.612600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce13d-529b-4f05-a539-b60595d52193 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:24.613083 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce13d-529b-4f05-a539-b60595d52193 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:24.614431 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ce13d-529b-4f05-a539-b60595d52193 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:24.616656 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ce13d-529b-4f05-a539-b60595d52193 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:24.639186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 338/688] 10.222.0.65 () {60 vars in 1141 bytes} [Mon Jul 25 23:59:24 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:59:24.699282 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:24.729502 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e1618-238d-4631-a6b5-8fea57a65e37 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:24.780882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78479d4-298a-497d-8211-d9907a003573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:24.781522 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78479d4-298a-497d-8211-d9907a003573 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:24.781782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78479d4-298a-497d-8211-d9907a003573 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:24.782056 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78479d4-298a-497d-8211-d9907a003573 None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:24.782834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78479d4-298a-497d-8211-d9907a003573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:24.783144 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78479d4-298a-497d-8211-d9907a003573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:24.784616 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78479d4-298a-497d-8211-d9907a003573 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:24.799591 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 351/689] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:24.805739 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ce13d-529b-4f05-a539-b60595d52193 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:24.879159 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:24.921233 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ce13d-529b-4f05-a539-b60595d52193 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:24.957244 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1296221-0547-4a89-9e8d-31de26e839f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:24.957922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1296221-0547-4a89-9e8d-31de26e839f2 None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:24.958204 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1296221-0547-4a89-9e8d-31de26e839f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:24.958482 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1296221-0547-4a89-9e8d-31de26e839f2 None admin] PATH_INFO: `/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/a513753b2f49408baf24402f1fa3c7e9/roles/5d947b934e0642c5a4ab00d547ec3fda` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:24.960569 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1296221-0547-4a89-9e8d-31de26e839f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d685fe7e12e4d86a5d5db9253e7e11f, user_id=a513753b2f49408baf24402f1fa3c7e9, role_id=5d947b934e0642c5a4ab00d547ec3fda)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:24.962017 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1296221-0547-4a89-9e8d-31de26e839f2 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:24.983334 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 339/690] 10.222.0.65 () {58 vars in 1439 bytes} [Mon Jul 25 23:59:24 2022] PUT /identity/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/a513753b2f49408baf24402f1fa3c7e9/roles/5d947b934e0642c5a4ab00d547ec3fda => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:59:25.787502 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353562c1-22fc-4fd9-9b25-1b56ba300957 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:25.788072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353562c1-22fc-4fd9-9b25-1b56ba300957 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:25.788349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353562c1-22fc-4fd9-9b25-1b56ba300957 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:25.790038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 352/691] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:25.795661 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4597e4-98bf-4d97-882d-d899bdc01261 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:25.795953 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4597e4-98bf-4d97-882d-d899bdc01261 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:25.796238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4597e4-98bf-4d97-882d-d899bdc01261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:25.814942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-7a4597e4-98bf-4d97-882d-d899bdc01261 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:25.816138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-7a4597e4-98bf-4d97-882d-d899bdc01261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:25.884740 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 340/692] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:25 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:59:25.908697 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353562c1-22fc-4fd9-9b25-1b56ba300957 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:26.019754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353562c1-22fc-4fd9-9b25-1b56ba300957 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:26.049677 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:26.055635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86614c1c-aba6-46ed-b87a-304c737a1e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:26.056274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86614c1c-aba6-46ed-b87a-304c737a1e2a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:26.056542 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86614c1c-aba6-46ed-b87a-304c737a1e2a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:26.056814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86614c1c-aba6-46ed-b87a-304c737a1e2a None admin] PATH_INFO: `/v3/services/image` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:26.057423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86614c1c-aba6-46ed-b87a-304c737a1e2a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:26.059244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86614c1c-aba6-46ed-b87a-304c737a1e2a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-86614c1c-aba6-46ed-b87a-304c737a1e2a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:26.068808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:26.069864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:26.070729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 353/693] 10.222.0.65 () {56 vars in 1105 bytes} [Mon Jul 25 23:59:25 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:26.076421 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4597e4-98bf-4d97-882d-d899bdc01261 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:26.136854 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:26.188811 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4597e4-98bf-4d97-882d-d899bdc01261 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:26.225628 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40be56d-06fb-4e35-ba0f-ceb91168c8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:26.226239 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40be56d-06fb-4e35-ba0f-ceb91168c8d3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:26.226512 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40be56d-06fb-4e35-ba0f-ceb91168c8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:26.226820 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40be56d-06fb-4e35-ba0f-ceb91168c8d3 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:26.227500 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40be56d-06fb-4e35-ba0f-ceb91168c8d3 None admin] RBAC: Adding query filter params (name=image) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:26.227799 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40be56d-06fb-4e35-ba0f-ceb91168c8d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:26.229168 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40be56d-06fb-4e35-ba0f-ceb91168c8d3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:26.234951 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 341/694] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:26.240159 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86614c1c-aba6-46ed-b87a-304c737a1e2a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:26.302120 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f8644-5d44-450b-a440-079f9821009e None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:26.302314 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f8644-5d44-450b-a440-079f9821009e None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:26.302585 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f8644-5d44-450b-a440-079f9821009e None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:26.304455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 342/695] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:59:26.311464 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb46e3b-6a9e-4de0-92b5-bb7459d46e6e None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:26.311464 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb46e3b-6a9e-4de0-92b5-bb7459d46e6e None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:26.311776 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb46e3b-6a9e-4de0-92b5-bb7459d46e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:26.331237 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-0bb46e3b-6a9e-4de0-92b5-bb7459d46e6e None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:26.332501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-0bb46e3b-6a9e-4de0-92b5-bb7459d46e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:26.347881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86614c1c-aba6-46ed-b87a-304c737a1e2a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:26.383624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a94b3-a8b8-4309-ab32-19d617fae394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:26.384604 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a94b3-a8b8-4309-ab32-19d617fae394 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:26.385085 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a94b3-a8b8-4309-ab32-19d617fae394 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:26.385558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a94b3-a8b8-4309-ab32-19d617fae394 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:26.386483 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a94b3-a8b8-4309-ab32-19d617fae394 None admin] RBAC: Adding query filter params (type=image) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:26.387026 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a94b3-a8b8-4309-ab32-19d617fae394 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:26.388635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a94b3-a8b8-4309-ab32-19d617fae394 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:26.394674 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 354/696] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:26.399910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a94b3-a8b8-4309-ab32-19d617fae394 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:26.415163 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 343/697] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:26 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:59:26.433505 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb46e3b-6a9e-4de0-92b5-bb7459d46e6e None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:26.471957 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:26.499969 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:26.538739 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a94b3-a8b8-4309-ab32-19d617fae394 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:26.551840 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb46e3b-6a9e-4de0-92b5-bb7459d46e6e None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:26.584700 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79af1f3-7ac6-4722-9569-83849680a06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:26.585647 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79af1f3-7ac6-4722-9569-83849680a06a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:26.586146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79af1f3-7ac6-4722-9569-83849680a06a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:26.586644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79af1f3-7ac6-4722-9569-83849680a06a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:26.587626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79af1f3-7ac6-4722-9569-83849680a06a None admin] RBAC: Adding query filter params (interface=public, service_id=2b1a554c1bbd4c82abd92c8457bff1a2, region_id=RegionOne) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:26.588140 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79af1f3-7ac6-4722-9569-83849680a06a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:26.589795 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79af1f3-7ac6-4722-9569-83849680a06a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:26.591424 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a23a6-0194-4198-8318-e95ebd03828f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:26.592449 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a23a6-0194-4198-8318-e95ebd03828f None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:26.592715 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a23a6-0194-4198-8318-e95ebd03828f None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:26.593052 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a23a6-0194-4198-8318-e95ebd03828f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:26.593762 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a23a6-0194-4198-8318-e95ebd03828f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:26.595418 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a23a6-0194-4198-8318-e95ebd03828f None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:26.600620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 355/698] 10.222.0.65 () {56 vars in 1251 bytes} [Mon Jul 25 23:59:26 2022] GET /identity/v3/endpoints?service_id=2b1a554c1bbd4c82abd92c8457bff1a2&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-717a23a6-0194-4198-8318-e95ebd03828f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:26.608779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:26.610065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:59:26.610942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:26.616292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79af1f3-7ac6-4722-9569-83849680a06a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:26.616371 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 344/699] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Jul 25 23:59:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:26.617259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a23a6-0194-4198-8318-e95ebd03828f None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:26.735787 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79af1f3-7ac6-4722-9569-83849680a06a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:26.743853 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a23a6-0194-4198-8318-e95ebd03828f None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:26.762231 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:26.767487 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:26.783094 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8a44a-03de-4f01-b925-a212d074a0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:26.783911 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8a44a-03de-4f01-b925-a212d074a0fc None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:26.784294 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8a44a-03de-4f01-b925-a212d074a0fc None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:26.784674 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8a44a-03de-4f01-b925-a212d074a0fc None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:26.785422 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8a44a-03de-4f01-b925-a212d074a0fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:26.786924 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8a44a-03de-4f01-b925-a212d074a0fc None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:26.789259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bd42e-3d49-4f34-8e56-bb48109ee612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:26.790056 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bd42e-3d49-4f34-8e56-bb48109ee612 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:26.790787 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bd42e-3d49-4f34-8e56-bb48109ee612 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:26.791208 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bd42e-3d49-4f34-8e56-bb48109ee612 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:26.792029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bd42e-3d49-4f34-8e56-bb48109ee612 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:26.792522 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bd42e-3d49-4f34-8e56-bb48109ee612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:26.794019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bd42e-3d49-4f34-8e56-bb48109ee612 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:26.798639 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 356/700] 10.222.0.65 () {56 vars in 1087 bytes} [Mon Jul 25 23:59:26 2022] GET /identity/v3/services => generated 1002 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:59:26.805579 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 345/701] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Jul 25 23:59:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:26.806732 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8a44a-03de-4f01-b925-a212d074a0fc None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:26.931683 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8a44a-03de-4f01-b925-a212d074a0fc None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:26.974533 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff285973-a4f2-4d4a-afbe-1a3568855863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:26.975503 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff285973-a4f2-4d4a-afbe-1a3568855863 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:26.975942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff285973-a4f2-4d4a-afbe-1a3568855863 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:26.976386 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff285973-a4f2-4d4a-afbe-1a3568855863 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:26.977221 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff285973-a4f2-4d4a-afbe-1a3568855863 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:26.977685 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff285973-a4f2-4d4a-afbe-1a3568855863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:26.979476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff285973-a4f2-4d4a-afbe-1a3568855863 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:26.986309 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 357/702] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Jul 25 23:59:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:26.992927 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bd42e-3d49-4f34-8e56-bb48109ee612 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:27.095711 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e4c0-b141-4e3d-8ada-4dcd2828e1af None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:27.096030 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e4c0-b141-4e3d-8ada-4dcd2828e1af None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:27.096264 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e4c0-b141-4e3d-8ada-4dcd2828e1af None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:27.097833 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 358/703] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:59:27.098524 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bd42e-3d49-4f34-8e56-bb48109ee612 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:27.106191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a5e9e-9001-40ae-b4ef-5c7d8e85f8a7 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:27.106473 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a5e9e-9001-40ae-b4ef-5c7d8e85f8a7 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:27.106785 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a5e9e-9001-40ae-b4ef-5c7d8e85f8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:27.128068 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-f36a5e9e-9001-40ae-b4ef-5c7d8e85f8a7 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:27.129273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-f36a5e9e-9001-40ae-b4ef-5c7d8e85f8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:27.143724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f85c9-d309-4430-a10d-09fa7c2a3e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:27.145130 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f85c9-d309-4430-a10d-09fa7c2a3e43 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:27.145899 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f85c9-d309-4430-a10d-09fa7c2a3e43 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:27.146374 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f85c9-d309-4430-a10d-09fa7c2a3e43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:27.147601 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f85c9-d309-4430-a10d-09fa7c2a3e43 None admin] RBAC: Adding query filter params (interface=public, service_id=75983195fed34a2ab927f3ba061f27c7, region_id=RegionOne) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:27.148446 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f85c9-d309-4430-a10d-09fa7c2a3e43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:27.149991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f85c9-d309-4430-a10d-09fa7c2a3e43 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:27.162158 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 346/704] 10.222.0.65 () {56 vars in 1251 bytes} [Mon Jul 25 23:59:26 2022] GET /identity/v3/endpoints?service_id=75983195fed34a2ab927f3ba061f27c7&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:27.168226 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f85c9-d309-4430-a10d-09fa7c2a3e43 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:27.188082 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:27.218131 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 359/705] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:27 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:59:27.242363 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a5e9e-9001-40ae-b4ef-5c7d8e85f8a7 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:27.247101 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:27.310171 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f85c9-d309-4430-a10d-09fa7c2a3e43 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:27.360687 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f357c0-2cd6-4d75-90ad-d1945e60ca9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:27.361317 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f357c0-2cd6-4d75-90ad-d1945e60ca9a None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:27.361605 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f357c0-2cd6-4d75-90ad-d1945e60ca9a None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:27.361887 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f357c0-2cd6-4d75-90ad-d1945e60ca9a None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:27.362539 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f357c0-2cd6-4d75-90ad-d1945e60ca9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:27.364009 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f357c0-2cd6-4d75-90ad-d1945e60ca9a None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:27.365115 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a5e9e-9001-40ae-b4ef-5c7d8e85f8a7 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:27.369667 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 347/706] 10.222.0.65 () {56 vars in 1087 bytes} [Mon Jul 25 23:59:27 2022] GET /identity/v3/services => generated 1002 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:59:27.370725 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaad312-496b-4e04-b62f-c82504edfc06 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:27.371020 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaad312-496b-4e04-b62f-c82504edfc06 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:27.371299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaad312-496b-4e04-b62f-c82504edfc06 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:27.372823 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 348/707] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:27.378057 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc741717-4c2f-4a27-add4-6d90138039ff None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:27.378346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc741717-4c2f-4a27-add4-6d90138039ff None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:27.378629 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc741717-4c2f-4a27-add4-6d90138039ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:27.399942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-dc741717-4c2f-4a27-add4-6d90138039ff None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:27.401186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-dc741717-4c2f-4a27-add4-6d90138039ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:27.417891 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bbb2c-6b74-4ca2-8601-d3fde8e7d56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:27.419245 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bbb2c-6b74-4ca2-8601-d3fde8e7d56c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:27.420378 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bbb2c-6b74-4ca2-8601-d3fde8e7d56c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:27.420992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bbb2c-6b74-4ca2-8601-d3fde8e7d56c None admin] PATH_INFO: `/v3/services/network` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:27.421918 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bbb2c-6b74-4ca2-8601-d3fde8e7d56c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:27.424463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bbb2c-6b74-4ca2-8601-d3fde8e7d56c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-f61bbb2c-6b74-4ca2-8601-d3fde8e7d56c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:27.438038 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:27.439208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:59:27.440053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:27.446637 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 360/708] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:27 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:59:27.449304 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bbb2c-6b74-4ca2-8601-d3fde8e7d56c None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:27.499073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 349/709] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:27 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:59:27.510381 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:27.521709 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc741717-4c2f-4a27-add4-6d90138039ff None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:27.577263 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:27.592585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bbb2c-6b74-4ca2-8601-d3fde8e7d56c None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:27.635105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d18407-c492-4d5d-baa0-0013d1426e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:27.635736 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d18407-c492-4d5d-baa0-0013d1426e1a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:27.636633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d18407-c492-4d5d-baa0-0013d1426e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:27.636827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d18407-c492-4d5d-baa0-0013d1426e1a None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:27.637510 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d18407-c492-4d5d-baa0-0013d1426e1a None admin] RBAC: Adding query filter params (name=network) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:27.637820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d18407-c492-4d5d-baa0-0013d1426e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:27.639249 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d18407-c492-4d5d-baa0-0013d1426e1a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:27.649011 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 361/710] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:27.651200 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d18407-c492-4d5d-baa0-0013d1426e1a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:27.661644 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc741717-4c2f-4a27-add4-6d90138039ff None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:27.700478 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1dda0-f8b6-4fd4-aa8c-912387a6ac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:27.701212 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1dda0-f8b6-4fd4-aa8c-912387a6ac7a None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:27.701595 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1dda0-f8b6-4fd4-aa8c-912387a6ac7a None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:27.701975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1dda0-f8b6-4fd4-aa8c-912387a6ac7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:27.715781 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1dda0-f8b6-4fd4-aa8c-912387a6ac7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-97e1dda0-f8b6-4fd4-aa8c-912387a6ac7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 23:59:27.722001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:27.723167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:27.724164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:27.724164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:27.724164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:27.724164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:27.724164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 23:59:27.724164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 23:59:27.724164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 23:59:27.724164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 23:59:27.724164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 23:59:27.724164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 23:59:27.724164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 23:59:27.724164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:27.726802 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 350/711] 10.222.0.65 () {56 vars in 1096 bytes} [Mon Jul 25 23:59:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:27.730736 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1dda0-f8b6-4fd4-aa8c-912387a6ac7a None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:27.785727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d18407-c492-4d5d-baa0-0013d1426e1a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:27.797060 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:27.830018 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b028229-4f59-4250-ad69-4474fba57108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:27.830856 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b028229-4f59-4250-ad69-4474fba57108 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:27.831140 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b028229-4f59-4250-ad69-4474fba57108 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:27.831413 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b028229-4f59-4250-ad69-4474fba57108 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:27.832086 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b028229-4f59-4250-ad69-4474fba57108 None admin] RBAC: Adding query filter params (type=network) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:27.832389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b028229-4f59-4250-ad69-4474fba57108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:27.834135 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b028229-4f59-4250-ad69-4474fba57108 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:27.842790 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 362/712] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:27.847778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b028229-4f59-4250-ad69-4474fba57108 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:27.861628 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:27.867726 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1dda0-f8b6-4fd4-aa8c-912387a6ac7a None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:27.912888 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b51da-d43f-4135-95e2-a33492117bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:27.913873 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b51da-d43f-4135-95e2-a33492117bf6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:27.914363 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b51da-d43f-4135-95e2-a33492117bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:27.914973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b51da-d43f-4135-95e2-a33492117bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:27.915937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b51da-d43f-4135-95e2-a33492117bf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:27.916465 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b51da-d43f-4135-95e2-a33492117bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:27.918593 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b51da-d43f-4135-95e2-a33492117bf6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:27.933004 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 351/713] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:27.934229 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b51da-d43f-4135-95e2-a33492117bf6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:27.988626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b028229-4f59-4250-ad69-4474fba57108 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:28.037584 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b5262-a3c8-4131-8e24-96c526388fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:28.038218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b5262-a3c8-4131-8e24-96c526388fc7 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:28.038500 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b5262-a3c8-4131-8e24-96c526388fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:28.038814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b5262-a3c8-4131-8e24-96c526388fc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:28.039886 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b5262-a3c8-4131-8e24-96c526388fc7 None admin] RBAC: Adding query filter params (interface=public, service_id=8e138db21f2f422cb0dd7fe415ff409c, region_id=RegionOne) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:28.040207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b5262-a3c8-4131-8e24-96c526388fc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:28.041981 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b5262-a3c8-4131-8e24-96c526388fc7 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:28.050785 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 363/714] 10.222.0.65 () {56 vars in 1251 bytes} [Mon Jul 25 23:59:27 2022] GET /identity/v3/endpoints?service_id=8e138db21f2f422cb0dd7fe415ff409c&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:28.056276 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b5262-a3c8-4131-8e24-96c526388fc7 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:28.062208 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b51da-d43f-4135-95e2-a33492117bf6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:28.101435 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40a76a-9a84-4856-916a-1d0f5f1ec624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:28.102436 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a76a-9a84-4856-916a-1d0f5f1ec624 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:28.103024 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a76a-9a84-4856-916a-1d0f5f1ec624 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:28.103525 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a76a-9a84-4856-916a-1d0f5f1ec624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:28.115195 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:28.116299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40a76a-9a84-4856-916a-1d0f5f1ec624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:28.117980 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40a76a-9a84-4856-916a-1d0f5f1ec624 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-0b40a76a-9a84-4856-916a-1d0f5f1ec624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:28.135814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:28.136983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:28.137849 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:28.137849 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:28.137849 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:28.137849 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:28.139860 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 352/715] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:28.148202 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40a76a-9a84-4856-916a-1d0f5f1ec624 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:28.164987 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:28.187100 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b5262-a3c8-4131-8e24-96c526388fc7 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:28.229582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce105b-ad15-44e6-9b93-3ac83f55c8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:28.230781 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce105b-ad15-44e6-9b93-3ac83f55c8b6 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:28.231067 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce105b-ad15-44e6-9b93-3ac83f55c8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:28.231338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce105b-ad15-44e6-9b93-3ac83f55c8b6 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:28.231984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce105b-ad15-44e6-9b93-3ac83f55c8b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:28.233350 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce105b-ad15-44e6-9b93-3ac83f55c8b6 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:28.242849 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 364/716] 10.222.0.65 () {56 vars in 1087 bytes} [Mon Jul 25 23:59:28 2022] GET /identity/v3/services => generated 1002 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:59:28.269108 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40a76a-9a84-4856-916a-1d0f5f1ec624 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:28.307714 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ff347-518a-4986-9c6a-7d51fe7967c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:28.308935 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ff347-518a-4986-9c6a-7d51fe7967c8 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:28.309460 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ff347-518a-4986-9c6a-7d51fe7967c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:28.309954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ff347-518a-4986-9c6a-7d51fe7967c8 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:28.310942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ff347-518a-4986-9c6a-7d51fe7967c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:28.311470 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ff347-518a-4986-9c6a-7d51fe7967c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:28.313100 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ff347-518a-4986-9c6a-7d51fe7967c8 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:28.328342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 353/717] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:28.334287 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce105b-ad15-44e6-9b93-3ac83f55c8b6 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:28.451899 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:28.456020 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce105b-ad15-44e6-9b93-3ac83f55c8b6 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:28.497379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cc510-4504-4931-9a8c-cd6df87cd729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:28.497950 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cc510-4504-4931-9a8c-cd6df87cd729 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:28.498233 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cc510-4504-4931-9a8c-cd6df87cd729 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:28.498512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cc510-4504-4931-9a8c-cd6df87cd729 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:28.506920 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cc510-4504-4931-9a8c-cd6df87cd729 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:28.508382 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cc510-4504-4931-9a8c-cd6df87cd729 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-344cc510-4504-4931-9a8c-cd6df87cd729 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:28.520744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:28.521712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:28.522635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:28.522635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:28.522635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:28.522635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:28.522635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:28.522635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:28.522635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:28.522635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:28.522635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 23:59:28.522635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:28.522635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 365/718] 10.222.0.65 () {56 vars in 1093 bytes} [Mon Jul 25 23:59:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:28.528444 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ff347-518a-4986-9c6a-7d51fe7967c8 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:28.610381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:28.642640 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ff347-518a-4986-9c6a-7d51fe7967c8 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:28.680526 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d426503-042f-4b9c-a99d-53c191f3bd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:28.681153 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d426503-042f-4b9c-a99d-53c191f3bd43 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:28.681433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d426503-042f-4b9c-a99d-53c191f3bd43 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:28.681710 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d426503-042f-4b9c-a99d-53c191f3bd43 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:28.682490 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d426503-042f-4b9c-a99d-53c191f3bd43 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:28.683002 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d426503-042f-4b9c-a99d-53c191f3bd43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:28.684477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d426503-042f-4b9c-a99d-53c191f3bd43 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:28.702482 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 354/719] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Jul 25 23:59:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:28.708031 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cc510-4504-4931-9a8c-cd6df87cd729 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:28.820518 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cc510-4504-4931-9a8c-cd6df87cd729 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:28.856610 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47666b56-6152-4166-bc07-783489d5aae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:28.857373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666b56-6152-4166-bc07-783489d5aae8 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:28.857560 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666b56-6152-4166-bc07-783489d5aae8 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:28.857896 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47666b56-6152-4166-bc07-783489d5aae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:28.915148 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:28.935439 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47666b56-6152-4166-bc07-783489d5aae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:28.936775 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47666b56-6152-4166-bc07-783489d5aae8 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:29.046993 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 366/720] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:59:28 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 23:59:29.052930 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d426503-042f-4b9c-a99d-53c191f3bd43 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:29.161465 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d426503-042f-4b9c-a99d-53c191f3bd43 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:29.192759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:29.199484 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14c053-ed9d-4b9a-aeb6-7bc5ed9631b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:29.200206 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14c053-ed9d-4b9a-aeb6-7bc5ed9631b8 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:29.200489 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14c053-ed9d-4b9a-aeb6-7bc5ed9631b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:29.200765 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14c053-ed9d-4b9a-aeb6-7bc5ed9631b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:29.212507 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14c053-ed9d-4b9a-aeb6-7bc5ed9631b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:29.213963 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14c053-ed9d-4b9a-aeb6-7bc5ed9631b8 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-3a14c053-ed9d-4b9a-aeb6-7bc5ed9631b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:29.229255 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:29.231185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:29.232434 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:29.232434 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:29.232434 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:29.232434 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:29.232434 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 355/721] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:29.236914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47666b56-6152-4166-bc07-783489d5aae8 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:29.243329 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e2b51-73fd-45ec-992d-5a205132415d None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:29.243329 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e2b51-73fd-45ec-992d-5a205132415d None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:29.243329 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e2b51-73fd-45ec-992d-5a205132415d None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:29.243907 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 356/722] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:29.250745 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4cb5b-56b7-4e05-a90e-f04edef9d759 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:29.250745 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4cb5b-56b7-4e05-a90e-f04edef9d759 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:29.250745 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4cb5b-56b7-4e05-a90e-f04edef9d759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:29.268112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-c1a4cb5b-56b7-4e05-a90e-f04edef9d759 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:29.269505 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-c1a4cb5b-56b7-4e05-a90e-f04edef9d759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:29.315174 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:29.346937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 357/723] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:29 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:59:29.351131 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47666b56-6152-4166-bc07-783489d5aae8 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:29.365608 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4cb5b-56b7-4e05-a90e-f04edef9d759 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:29.395173 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02dca93-6635-4f17-ad2e-38be22292979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:29.396708 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02dca93-6635-4f17-ad2e-38be22292979 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:29.397196 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02dca93-6635-4f17-ad2e-38be22292979 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:29.397686 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02dca93-6635-4f17-ad2e-38be22292979 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:29.399023 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02dca93-6635-4f17-ad2e-38be22292979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:29.399810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02dca93-6635-4f17-ad2e-38be22292979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:29.402765 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02dca93-6635-4f17-ad2e-38be22292979 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:29.417451 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 367/724] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:29.424118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02dca93-6635-4f17-ad2e-38be22292979 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:29.484011 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4cb5b-56b7-4e05-a90e-f04edef9d759 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:29.501275 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:29.528915 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7339f-de33-4823-bc06-38baae13731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:29.529564 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7339f-de33-4823-bc06-38baae13731c None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:29.529842 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7339f-de33-4823-bc06-38baae13731c None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:29.530114 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7339f-de33-4823-bc06-38baae13731c None admin] PATH_INFO: `/v3/services/image` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:29.530759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7339f-de33-4823-bc06-38baae13731c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:29.532168 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7339f-de33-4823-bc06-38baae13731c None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-25f7339f-de33-4823-bc06-38baae13731c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:29.541362 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:29.542479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 23:59:29.543355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:29.547677 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 358/725] 10.222.0.65 () {56 vars in 1105 bytes} [Mon Jul 25 23:59:29 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:59:29.548996 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7339f-de33-4823-bc06-38baae13731c None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:29.556657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02dca93-6635-4f17-ad2e-38be22292979 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:29.580383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:29.598508 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a2761-3775-4293-afdd-15efaa457522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:29.599553 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a2761-3775-4293-afdd-15efaa457522 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:29.600020 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a2761-3775-4293-afdd-15efaa457522 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:29.600480 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a2761-3775-4293-afdd-15efaa457522 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:29.608649 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a2761-3775-4293-afdd-15efaa457522 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:29.610395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a2761-3775-4293-afdd-15efaa457522 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-ce4a2761-3775-4293-afdd-15efaa457522 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:29.624587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:29.625504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:29.626395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:29.626395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:29.626395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:29.626395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:29.626395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:29.626395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:29.626395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:29.626395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:29.633899 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 368/726] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:29.635046 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a2761-3775-4293-afdd-15efaa457522 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:29.656359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7339f-de33-4823-bc06-38baae13731c None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:29.694380 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56b53c-b02a-4c96-ac36-187acf4759fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:29.694942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56b53c-b02a-4c96-ac36-187acf4759fa None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:29.695414 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56b53c-b02a-4c96-ac36-187acf4759fa None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:29.695699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56b53c-b02a-4c96-ac36-187acf4759fa None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:29.696498 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56b53c-b02a-4c96-ac36-187acf4759fa None admin] RBAC: Adding query filter params (name=image) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:29.696808 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56b53c-b02a-4c96-ac36-187acf4759fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:29.698203 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56b53c-b02a-4c96-ac36-187acf4759fa None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:29.703382 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 359/727] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:29.704451 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85e56-f664-48e0-a041-c3d8adf8c6e3 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:29.704743 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85e56-f664-48e0-a041-c3d8adf8c6e3 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:29.705083 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85e56-f664-48e0-a041-c3d8adf8c6e3 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:29.706413 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 360/728] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:29.711007 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c85e56-f664-48e0-a041-c3d8adf8c6e3 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:29.756720 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:29.763072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a2761-3775-4293-afdd-15efaa457522 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:29.798300 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e724e8-19f3-43de-8348-bf6139c6f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:29.799146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e724e8-19f3-43de-8348-bf6139c6f2e2 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:29.799260 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e724e8-19f3-43de-8348-bf6139c6f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:29.799501 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e724e8-19f3-43de-8348-bf6139c6f2e2 None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:29.800231 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e724e8-19f3-43de-8348-bf6139c6f2e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:29.800545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e724e8-19f3-43de-8348-bf6139c6f2e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:29.802128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e724e8-19f3-43de-8348-bf6139c6f2e2 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:29.821109 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 369/729] 10.222.0.65 () {56 vars in 1148 bytes} [Mon Jul 25 23:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:29.822352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c971f06-4c64-405a-b135-63d4add43898 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:29.822639 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c971f06-4c64-405a-b135-63d4add43898 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:29.822941 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c971f06-4c64-405a-b135-63d4add43898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:29.825403 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c85e56-f664-48e0-a041-c3d8adf8c6e3 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:29.843636 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-6c971f06-4c64-405a-b135-63d4add43898 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:29.844816 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-6c971f06-4c64-405a-b135-63d4add43898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:29.861771 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d98fb-84b7-445f-af38-f61acbf9a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:29.862402 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d98fb-84b7-445f-af38-f61acbf9a501 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:29.862680 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d98fb-84b7-445f-af38-f61acbf9a501 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:29.862989 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d98fb-84b7-445f-af38-f61acbf9a501 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:29.863672 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d98fb-84b7-445f-af38-f61acbf9a501 None admin] RBAC: Adding query filter params (type=image) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:29.863954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d98fb-84b7-445f-af38-f61acbf9a501 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:29.865331 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d98fb-84b7-445f-af38-f61acbf9a501 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:29.870803 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 361/730] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:29.876152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d98fb-84b7-445f-af38-f61acbf9a501 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:29.884350 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:29.927127 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 370/731] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:29 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:59:29.927127 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c971f06-4c64-405a-b135-63d4add43898 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:29.999452 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d98fb-84b7-445f-af38-f61acbf9a501 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:30.003016 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:30.037309 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c971f06-4c64-405a-b135-63d4add43898 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:30.037896 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cf6d8-7574-46d9-aa4f-643b712fe266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:30.038516 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cf6d8-7574-46d9-aa4f-643b712fe266 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:30.038835 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cf6d8-7574-46d9-aa4f-643b712fe266 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:30.039108 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cf6d8-7574-46d9-aa4f-643b712fe266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:30.039897 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cf6d8-7574-46d9-aa4f-643b712fe266 None admin] RBAC: Adding query filter params (role.id=5d947b934e0642c5a4ab00d547ec3fda, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=a513753b2f49408baf24402f1fa3c7e9) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:30.040207 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cf6d8-7574-46d9-aa4f-643b712fe266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:30.041637 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cf6d8-7574-46d9-aa4f-643b712fe266 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:30.058737 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 362/732] 10.222.0.65 () {56 vars in 1374 bytes} [Mon Jul 25 23:59:29 2022] GET /identity/v3/role_assignments?user.id=a513753b2f49408baf24402f1fa3c7e9&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=5d947b934e0642c5a4ab00d547ec3fda => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:30.058737 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cf6d8-7574-46d9-aa4f-643b712fe266 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:30.088132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da874f04-4fb6-4e3f-a6db-745e2cfdf41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:30.088851 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da874f04-4fb6-4e3f-a6db-745e2cfdf41a None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:30.089919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da874f04-4fb6-4e3f-a6db-745e2cfdf41a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:30.090254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da874f04-4fb6-4e3f-a6db-745e2cfdf41a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:30.091232 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da874f04-4fb6-4e3f-a6db-745e2cfdf41a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:30.092799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da874f04-4fb6-4e3f-a6db-745e2cfdf41a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:30.121325 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 371/733] 10.222.0.65 () {60 vars in 1144 bytes} [Mon Jul 25 23:59:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:59:30.206497 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cf6d8-7574-46d9-aa4f-643b712fe266 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:30.258003 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1e700-cb29-4305-be20-9655e730a415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:30.259458 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e700-cb29-4305-be20-9655e730a415 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:30.259458 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e700-cb29-4305-be20-9655e730a415 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:30.259458 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e700-cb29-4305-be20-9655e730a415 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:30.259850 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1e700-cb29-4305-be20-9655e730a415 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:30.262072 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1e700-cb29-4305-be20-9655e730a415 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-cda1e700-cb29-4305-be20-9655e730a415 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:30.272288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:30.273270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:30.274084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 363/734] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Jul 25 23:59:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:30.282735 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da874f04-4fb6-4e3f-a6db-745e2cfdf41a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:30.315563 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:30.404397 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da874f04-4fb6-4e3f-a6db-745e2cfdf41a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:30.445274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808b642-62de-4f15-8a86-c1acd48a8549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:30.446291 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b642-62de-4f15-8a86-c1acd48a8549 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:30.446866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b642-62de-4f15-8a86-c1acd48a8549 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:30.447345 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b642-62de-4f15-8a86-c1acd48a8549 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:30.448229 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808b642-62de-4f15-8a86-c1acd48a8549 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:30.449744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808b642-62de-4f15-8a86-c1acd48a8549 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:30.451394 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808b642-62de-4f15-8a86-c1acd48a8549 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:30.457351 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 372/735] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Jul 25 23:59:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:30.465289 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1e700-cb29-4305-be20-9655e730a415 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:30.508268 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:30.579990 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1e700-cb29-4305-be20-9655e730a415 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:30.616210 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af264b79-d4a3-4a37-b97a-c290196e57f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:30.616835 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264b79-d4a3-4a37-b97a-c290196e57f4 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:30.617119 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264b79-d4a3-4a37-b97a-c290196e57f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:30.617393 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264b79-d4a3-4a37-b97a-c290196e57f4 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:30.618073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af264b79-d4a3-4a37-b97a-c290196e57f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:30.618379 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af264b79-d4a3-4a37-b97a-c290196e57f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:30.619809 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af264b79-d4a3-4a37-b97a-c290196e57f4 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:30.626418 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 364/736] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Jul 25 23:59:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:30.627408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380384b-a27e-4af4-953a-d918e63c0a51 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:30.627701 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380384b-a27e-4af4-953a-d918e63c0a51 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:30.627985 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380384b-a27e-4af4-953a-d918e63c0a51 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:30.629522 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 373/737] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:30.631881 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af264b79-d4a3-4a37-b97a-c290196e57f4 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:30.634481 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9131d8-5d2e-49c5-b83e-9a519157c468 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:30.634804 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9131d8-5d2e-49c5-b83e-9a519157c468 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:30.635088 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9131d8-5d2e-49c5-b83e-9a519157c468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:30.653809 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-db9131d8-5d2e-49c5-b83e-9a519157c468 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:30.655033 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-db9131d8-5d2e-49c5-b83e-9a519157c468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:30.743695 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 374/738] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:30 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:59:30.747815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:30.761079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af264b79-d4a3-4a37-b97a-c290196e57f4 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:30.768946 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9131d8-5d2e-49c5-b83e-9a519157c468 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:30.797058 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:30.801190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a09358-c6f7-4f99-b101-3bbdc5af8f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:30.802111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a09358-c6f7-4f99-b101-3bbdc5af8f30 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:30.802597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a09358-c6f7-4f99-b101-3bbdc5af8f30 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:30.803112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a09358-c6f7-4f99-b101-3bbdc5af8f30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:30.804281 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a09358-c6f7-4f99-b101-3bbdc5af8f30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:30.805943 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a09358-c6f7-4f99-b101-3bbdc5af8f30 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:30.834239 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 365/739] 10.222.0.65 () {60 vars in 1144 bytes} [Mon Jul 25 23:59:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:59:30.897593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9131d8-5d2e-49c5-b83e-9a519157c468 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:30.949747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb6bd4-2984-4196-b0b0-3bed75ed071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:30.950451 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb6bd4-2984-4196-b0b0-3bed75ed071d None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:30.950816 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb6bd4-2984-4196-b0b0-3bed75ed071d None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:30.951107 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb6bd4-2984-4196-b0b0-3bed75ed071d None admin] PATH_INFO: `/v3/services/network` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:30.951735 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb6bd4-2984-4196-b0b0-3bed75ed071d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:30.953123 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb6bd4-2984-4196-b0b0-3bed75ed071d None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-b2fb6bd4-2984-4196-b0b0-3bed75ed071d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:30.963690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:30.965349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:30.966181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 375/740] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:30 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:59:30.974377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a09358-c6f7-4f99-b101-3bbdc5af8f30 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:31.092506 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a09358-c6f7-4f99-b101-3bbdc5af8f30 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:31.128594 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354400d8-022b-4d50-aa9b-4b1b0487079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:31.129217 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354400d8-022b-4d50-aa9b-4b1b0487079e None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:31.129495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354400d8-022b-4d50-aa9b-4b1b0487079e None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:31.129770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354400d8-022b-4d50-aa9b-4b1b0487079e None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:31.130435 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354400d8-022b-4d50-aa9b-4b1b0487079e None admin] RBAC: Adding query filter params (name=network) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:31.130764 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354400d8-022b-4d50-aa9b-4b1b0487079e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:31.132155 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354400d8-022b-4d50-aa9b-4b1b0487079e None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:31.137334 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 366/741] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:31.143145 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb6bd4-2984-4196-b0b0-3bed75ed071d None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:31.241824 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:31.263135 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb6bd4-2984-4196-b0b0-3bed75ed071d None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:31.299393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139a50f-32c4-4fa7-9230-863b5413704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:31.300012 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139a50f-32c4-4fa7-9230-863b5413704d None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:31.300294 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139a50f-32c4-4fa7-9230-863b5413704d None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:31.300568 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139a50f-32c4-4fa7-9230-863b5413704d None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:31.301379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139a50f-32c4-4fa7-9230-863b5413704d None admin] RBAC: Adding query filter params (type=network) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:31.301689 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139a50f-32c4-4fa7-9230-863b5413704d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:31.303092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139a50f-32c4-4fa7-9230-863b5413704d None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:31.309249 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 376/742] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:31.315778 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354400d8-022b-4d50-aa9b-4b1b0487079e None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:31.333365 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:31.435208 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354400d8-022b-4d50-aa9b-4b1b0487079e None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:31.471333 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae031-66e3-4209-b8c6-dcb3fe924137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:31.471952 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae031-66e3-4209-b8c6-dcb3fe924137 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:31.472233 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae031-66e3-4209-b8c6-dcb3fe924137 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:31.472509 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae031-66e3-4209-b8c6-dcb3fe924137 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:31.473213 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cae031-66e3-4209-b8c6-dcb3fe924137 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:31.474587 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cae031-66e3-4209-b8c6-dcb3fe924137 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:31.496536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 367/743] 10.222.0.65 () {60 vars in 1144 bytes} [Mon Jul 25 23:59:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:59:32.509641 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412798ba-f115-492c-a34f-a0328e3bd432 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:32.510195 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412798ba-f115-492c-a34f-a0328e3bd432 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:32.510195 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412798ba-f115-492c-a34f-a0328e3bd432 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:32.512259 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 377/744] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:32.516937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72510691-7526-4e05-b7e5-47b590753a28 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:32.517560 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a0b6-2acc-4fe8-82aa-9cfdde4a635d None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:32.517737 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a0b6-2acc-4fe8-82aa-9cfdde4a635d None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:32.517992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a0b6-2acc-4fe8-82aa-9cfdde4a635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:32.522792 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72510691-7526-4e05-b7e5-47b590753a28 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:32.523462 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72510691-7526-4e05-b7e5-47b590753a28 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:32.524855 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 368/745] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:32.530389 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96681ed1-c2d2-48de-810a-87b1001dd049 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:32.530676 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96681ed1-c2d2-48de-810a-87b1001dd049 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:32.531002 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96681ed1-c2d2-48de-810a-87b1001dd049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:32.536594 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-2ab1a0b6-2acc-4fe8-82aa-9cfdde4a635d None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:32.538821 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-2ab1a0b6-2acc-4fe8-82aa-9cfdde4a635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:32.548810 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-96681ed1-c2d2-48de-810a-87b1001dd049 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:32.549961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-96681ed1-c2d2-48de-810a-87b1001dd049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:32.616665 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:32.619379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 378/746] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:32 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:59:32.630880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 369/747] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:32 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:59:32.643105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1a0b6-2acc-4fe8-82aa-9cfdde4a635d None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:32.652165 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96681ed1-c2d2-48de-810a-87b1001dd049 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:32.720073 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:32.755523 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1a0b6-2acc-4fe8-82aa-9cfdde4a635d None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:32.762018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96681ed1-c2d2-48de-810a-87b1001dd049 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:32.793831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1cf7c-3d6f-41f5-bc31-ad018be9e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:32.794463 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1cf7c-3d6f-41f5-bc31-ad018be9e527 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:32.794762 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1cf7c-3d6f-41f5-bc31-ad018be9e527 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:32.795036 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1cf7c-3d6f-41f5-bc31-ad018be9e527 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:32.795649 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1cf7c-3d6f-41f5-bc31-ad018be9e527 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:32.797020 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1cf7c-3d6f-41f5-bc31-ad018be9e527 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:32.798400 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41e44d-b4d2-4a7f-a9eb-265e40d97082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:32.799049 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41e44d-b4d2-4a7f-a9eb-265e40d97082 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:32.799334 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41e44d-b4d2-4a7f-a9eb-265e40d97082 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:32.799624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41e44d-b4d2-4a7f-a9eb-265e40d97082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-bca1cf7c-3d6f-41f5-bc31-ad018be9e527 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:32.806456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:32.807406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:59:32.808444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:32.815073 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 379/748] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Jul 25 23:59:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:32.816323 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1cf7c-3d6f-41f5-bc31-ad018be9e527 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:32.869689 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:32.875477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41e44d-b4d2-4a7f-a9eb-265e40d97082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:32.877382 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41e44d-b4d2-4a7f-a9eb-265e40d97082 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:32.920432 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1cf7c-3d6f-41f5-bc31-ad018be9e527 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:32.958177 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d6513-5d7e-40d7-8f4a-9a2370a580bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:32.958827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d6513-5d7e-40d7-8f4a-9a2370a580bc None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:32.959278 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d6513-5d7e-40d7-8f4a-9a2370a580bc None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:32.959566 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d6513-5d7e-40d7-8f4a-9a2370a580bc None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:32.960643 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d6513-5d7e-40d7-8f4a-9a2370a580bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:32.960961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d6513-5d7e-40d7-8f4a-9a2370a580bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:32.962698 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d6513-5d7e-40d7-8f4a-9a2370a580bc None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:32.964915 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:32.975040 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 380/749] 10.222.0.65 () {56 vars in 1126 bytes} [Mon Jul 25 23:59:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:32.975879 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d6513-5d7e-40d7-8f4a-9a2370a580bc None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:32.996692 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 370/750] 10.222.0.65 () {58 vars in 1282 bytes} [Mon Jul 25 23:59:32 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 23:59:33.002197 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41e44d-b4d2-4a7f-a9eb-265e40d97082 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:33.088371 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d6513-5d7e-40d7-8f4a-9a2370a580bc None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:33.109235 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:33.113770 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41e44d-b4d2-4a7f-a9eb-265e40d97082 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:33.125638 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafe934-deb8-42a8-b6ad-cc2f870242b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:33.126265 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafe934-deb8-42a8-b6ad-cc2f870242b6 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:33.126544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafe934-deb8-42a8-b6ad-cc2f870242b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:33.126864 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafe934-deb8-42a8-b6ad-cc2f870242b6 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:33.127531 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafe934-deb8-42a8-b6ad-cc2f870242b6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:33.127834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafe934-deb8-42a8-b6ad-cc2f870242b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:33.129207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafe934-deb8-42a8-b6ad-cc2f870242b6 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:33.133899 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 381/751] 10.222.0.65 () {56 vars in 1126 bytes} [Mon Jul 25 23:59:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:33.155948 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5f7a6-5250-4d83-8e81-a7bb2df2c153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:33.156608 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5f7a6-5250-4d83-8e81-a7bb2df2c153 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:33.156883 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5f7a6-5250-4d83-8e81-a7bb2df2c153 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:33.157156 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5f7a6-5250-4d83-8e81-a7bb2df2c153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:33.169838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5f7a6-5250-4d83-8e81-a7bb2df2c153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:33.171360 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5f7a6-5250-4d83-8e81-a7bb2df2c153 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-e9b5f7a6-5250-4d83-8e81-a7bb2df2c153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 23:59:33.189346 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:33.190303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:33.191444 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 23:59:33.191444 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 23:59:33.191444 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 23:59:33.191444 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:33.195134 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 371/752] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Jul 25 23:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:59:33.196726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafe934-deb8-42a8-b6ad-cc2f870242b6 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:33.202223 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71045020-5387-4f7e-b743-a0d563f76e25 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:33.202527 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71045020-5387-4f7e-b743-a0d563f76e25 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:33.202823 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71045020-5387-4f7e-b743-a0d563f76e25 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:33.204323 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 372/753] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:33.209807 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858f859-d394-470d-b60e-abb7dac802c0 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:33.210090 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858f859-d394-470d-b60e-abb7dac802c0 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:33.210372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858f859-d394-470d-b60e-abb7dac802c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:33.231018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-8858f859-d394-470d-b60e-abb7dac802c0 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:33.232292 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-8858f859-d394-470d-b60e-abb7dac802c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:33.270948 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:33.311397 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 373/754] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:33 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:59:33.317252 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafe934-deb8-42a8-b6ad-cc2f870242b6 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:33.334539 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858f859-d394-470d-b60e-abb7dac802c0 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:33.354636 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e09be9-8cd6-4265-8ea0-3c44b9a3a81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:33.355838 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09be9-8cd6-4265-8ea0-3c44b9a3a81c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:33.356213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09be9-8cd6-4265-8ea0-3c44b9a3a81c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:33.356495 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09be9-8cd6-4265-8ea0-3c44b9a3a81c None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:33.357181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e09be9-8cd6-4265-8ea0-3c44b9a3a81c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:33.357490 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e09be9-8cd6-4265-8ea0-3c44b9a3a81c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:33.358896 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e09be9-8cd6-4265-8ea0-3c44b9a3a81c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:33.378809 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 382/755] 10.222.0.65 () {56 vars in 1109 bytes} [Mon Jul 25 23:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:33.427195 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:33.450843 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858f859-d394-470d-b60e-abb7dac802c0 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:33.488343 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32468152-844d-4380-867b-9236549247d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:33.489005 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32468152-844d-4380-867b-9236549247d6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:33.489284 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32468152-844d-4380-867b-9236549247d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:33.489556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32468152-844d-4380-867b-9236549247d6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:33.490185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32468152-844d-4380-867b-9236549247d6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:33.491682 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32468152-844d-4380-867b-9236549247d6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-32468152-844d-4380-867b-9236549247d6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:33.501974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:33.503122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:33.504562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 374/756] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:59:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:59:33.509208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e09be9-8cd6-4265-8ea0-3c44b9a3a81c None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:33.618099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e09be9-8cd6-4265-8ea0-3c44b9a3a81c None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:33.642024 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:33.655623 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68414-6353-4d19-ad84-212162ed354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:33.656310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68414-6353-4d19-ad84-212162ed354c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:33.656637 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68414-6353-4d19-ad84-212162ed354c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:33.656956 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68414-6353-4d19-ad84-212162ed354c None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:33.657676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68414-6353-4d19-ad84-212162ed354c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:33.658183 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68414-6353-4d19-ad84-212162ed354c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:33.659694 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68414-6353-4d19-ad84-212162ed354c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:33.665216 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 383/757] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:59:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:33.671761 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32468152-844d-4380-867b-9236549247d6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:33.776072 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32468152-844d-4380-867b-9236549247d6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:33.809621 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f97de6-e14d-471d-8dfa-5322f913f67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:33.810232 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f97de6-e14d-471d-8dfa-5322f913f67e None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:33.810513 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f97de6-e14d-471d-8dfa-5322f913f67e None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:33.810821 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f97de6-e14d-471d-8dfa-5322f913f67e None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:33.811486 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f97de6-e14d-471d-8dfa-5322f913f67e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:33.811789 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f97de6-e14d-471d-8dfa-5322f913f67e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:33.813149 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f97de6-e14d-471d-8dfa-5322f913f67e None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:33.817516 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 375/758] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:59:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:35.381175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bafea-36c8-482f-9cfe-271b0414261b None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:35.381702 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bafea-36c8-482f-9cfe-271b0414261b None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:35.381702 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bafea-36c8-482f-9cfe-271b0414261b None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:35.383067 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 384/759] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:35.388128 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6107-38ab-464e-a9a8-74f99358d991 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:35.388515 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6107-38ab-464e-a9a8-74f99358d991 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:35.388675 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6107-38ab-464e-a9a8-74f99358d991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:35.406942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-5d7d6107-38ab-464e-a9a8-74f99358d991 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:35.408100 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-5d7d6107-38ab-464e-a9a8-74f99358d991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:35.410029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:35.473396 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 376/760] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:35 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:59:35.496937 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bafea-36c8-482f-9cfe-271b0414261b None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:35.608295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bafea-36c8-482f-9cfe-271b0414261b None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:35.642090 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842a960-6955-437d-88b5-8daecafe7e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:35.642618 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842a960-6955-437d-88b5-8daecafe7e87 None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:35.642921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842a960-6955-437d-88b5-8daecafe7e87 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:35.643191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842a960-6955-437d-88b5-8daecafe7e87 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:35.643866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842a960-6955-437d-88b5-8daecafe7e87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:35.645221 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842a960-6955-437d-88b5-8daecafe7e87 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:35.660548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 385/761] 10.222.0.65 () {60 vars in 1141 bytes} [Mon Jul 25 23:59:35 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:59:36.033655 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948455d-6a3d-423b-8f19-db420cc7a736 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:36.033935 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948455d-6a3d-423b-8f19-db420cc7a736 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:36.034207 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948455d-6a3d-423b-8f19-db420cc7a736 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:36.035578 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 377/762] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:36.040837 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad35003-e917-4ae7-a788-805773e714f0 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:36.041122 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad35003-e917-4ae7-a788-805773e714f0 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:36.041395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad35003-e917-4ae7-a788-805773e714f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:36.060513 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-6ad35003-e917-4ae7-a788-805773e714f0 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:36.061678 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-6ad35003-e917-4ae7-a788-805773e714f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:36.103247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:36.134956 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 386/763] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:36 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:59:36.159619 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948455d-6a3d-423b-8f19-db420cc7a736 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:36.262558 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948455d-6a3d-423b-8f19-db420cc7a736 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:36.294401 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c075e-3b97-43cf-b6e2-c2344228b491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:36.295043 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c075e-3b97-43cf-b6e2-c2344228b491 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:36.295321 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c075e-3b97-43cf-b6e2-c2344228b491 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:36.295591 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c075e-3b97-43cf-b6e2-c2344228b491 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:36.296274 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c075e-3b97-43cf-b6e2-c2344228b491 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:36.297631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c075e-3b97-43cf-b6e2-c2344228b491 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:36.307489 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:36.315089 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 378/764] 10.222.0.65 () {60 vars in 1141 bytes} [Mon Jul 25 23:59:36 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:59:37.901629 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6683038-af5c-4302-971c-fa107993e967 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:37.902162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6683038-af5c-4302-971c-fa107993e967 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:37.902162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6683038-af5c-4302-971c-fa107993e967 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:37.903537 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 387/765] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:37.908805 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f3648-31cd-4cbe-a2f0-fe6b3cf5fa43 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:37.909200 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f3648-31cd-4cbe-a2f0-fe6b3cf5fa43 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:37.909349 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f3648-31cd-4cbe-a2f0-fe6b3cf5fa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:37.927545 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-471f3648-31cd-4cbe-a2f0-fe6b3cf5fa43 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:37.928714 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-471f3648-31cd-4cbe-a2f0-fe6b3cf5fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:38.001177 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 379/766] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:37 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:59:38.025413 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6683038-af5c-4302-971c-fa107993e967 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:38.125492 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6683038-af5c-4302-971c-fa107993e967 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:38.159113 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f697a-7609-4bc9-82d9-05174800de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:38.159668 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f697a-7609-4bc9-82d9-05174800de76 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:38.159942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f697a-7609-4bc9-82d9-05174800de76 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:38.160209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f697a-7609-4bc9-82d9-05174800de76 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:38.160818 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f697a-7609-4bc9-82d9-05174800de76 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:38.162179 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f697a-7609-4bc9-82d9-05174800de76 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-5a2f697a-7609-4bc9-82d9-05174800de76 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:38.173423 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:38.174559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:38.175452 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 388/767] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Jul 25 23:59:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:38.180754 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f3648-31cd-4cbe-a2f0-fe6b3cf5fa43 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:38.275325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f3648-31cd-4cbe-a2f0-fe6b3cf5fa43 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:38.298774 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:38.309814 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d7200-5469-4494-b5f1-eea8a5b4b1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:38.310423 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d7200-5469-4494-b5f1-eea8a5b4b1f3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:38.310715 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d7200-5469-4494-b5f1-eea8a5b4b1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:38.311007 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d7200-5469-4494-b5f1-eea8a5b4b1f3 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:38.311670 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d7200-5469-4494-b5f1-eea8a5b4b1f3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:38.311974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d7200-5469-4494-b5f1-eea8a5b4b1f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:38.313339 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d7200-5469-4494-b5f1-eea8a5b4b1f3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:38.318067 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 380/768] 10.222.0.65 () {56 vars in 1126 bytes} [Mon Jul 25 23:59:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:38.323527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f697a-7609-4bc9-82d9-05174800de76 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:38.358208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:38.424749 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f697a-7609-4bc9-82d9-05174800de76 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:38.457772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc2f28-609f-46be-80ec-a225ad80a900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:38.458376 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc2f28-609f-46be-80ec-a225ad80a900 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:38.458651 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc2f28-609f-46be-80ec-a225ad80a900 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:38.458953 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc2f28-609f-46be-80ec-a225ad80a900 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:38.459614 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc2f28-609f-46be-80ec-a225ad80a900 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:38.459915 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc2f28-609f-46be-80ec-a225ad80a900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:38.461265 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc2f28-609f-46be-80ec-a225ad80a900 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:38.466606 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 389/769] 10.222.0.65 () {56 vars in 1126 bytes} [Mon Jul 25 23:59:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:38.472688 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d7200-5469-4494-b5f1-eea8a5b4b1f3 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:38.558173 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a93808-0e88-43a0-b75a-954181a9f75f None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:38.558459 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a93808-0e88-43a0-b75a-954181a9f75f None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:38.558774 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a93808-0e88-43a0-b75a-954181a9f75f None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:38.560111 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 390/770] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:59:38.565115 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b02e31-6e39-4947-acea-c8e16a683885 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:38.565400 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b02e31-6e39-4947-acea-c8e16a683885 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:38.565673 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b02e31-6e39-4947-acea-c8e16a683885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:38.571561 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d7200-5469-4494-b5f1-eea8a5b4b1f3 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:38.583662 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-63b02e31-6e39-4947-acea-c8e16a683885 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:38.584833 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-63b02e31-6e39-4947-acea-c8e16a683885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:38.606616 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1798c93-6600-4899-8542-be1f5d5cf8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:38.607261 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1798c93-6600-4899-8542-be1f5d5cf8cb None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:38.607538 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1798c93-6600-4899-8542-be1f5d5cf8cb None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:38.607811 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1798c93-6600-4899-8542-be1f5d5cf8cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:38.608554 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1798c93-6600-4899-8542-be1f5d5cf8cb None admin] RBAC: Adding query filter params (interface=public, service_id=19c800be065b409e89eae4224568545f, region_id=RegionOne) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:38.608862 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1798c93-6600-4899-8542-be1f5d5cf8cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:38.610245 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1798c93-6600-4899-8542-be1f5d5cf8cb None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:38.615331 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 381/771] 10.222.0.65 () {56 vars in 1251 bytes} [Mon Jul 25 23:59:38 2022] GET /identity/v3/endpoints?service_id=19c800be065b409e89eae4224568545f&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:38.620615 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1798c93-6600-4899-8542-be1f5d5cf8cb None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:38.653823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 391/772] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:38 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:59:38.673230 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:38.680008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b02e31-6e39-4947-acea-c8e16a683885 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:38.708814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:38.719977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1798c93-6600-4899-8542-be1f5d5cf8cb None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:38.754229 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9a894-c0d0-4d36-9f92-2d8420ce93f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:38.754897 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9a894-c0d0-4d36-9f92-2d8420ce93f6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:38.755187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9a894-c0d0-4d36-9f92-2d8420ce93f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:38.755458 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9a894-c0d0-4d36-9f92-2d8420ce93f6 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:38.756101 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9a894-c0d0-4d36-9f92-2d8420ce93f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:38.757466 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9a894-c0d0-4d36-9f92-2d8420ce93f6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:38.764146 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 382/773] 10.222.0.65 () {56 vars in 1087 bytes} [Mon Jul 25 23:59:38 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:59:38.778453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b02e31-6e39-4947-acea-c8e16a683885 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:38.816685 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022db314-01ac-4d6d-8bd3-ae9043fc6e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:38.817342 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022db314-01ac-4d6d-8bd3-ae9043fc6e39 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:38.817616 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022db314-01ac-4d6d-8bd3-ae9043fc6e39 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:38.817888 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022db314-01ac-4d6d-8bd3-ae9043fc6e39 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:38.818514 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022db314-01ac-4d6d-8bd3-ae9043fc6e39 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:38.820069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022db314-01ac-4d6d-8bd3-ae9043fc6e39 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-022db314-01ac-4d6d-8bd3-ae9043fc6e39 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:38.830305 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:38.831646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:38.832726 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 392/774] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:59:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 23:59:38.837787 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9a894-c0d0-4d36-9f92-2d8420ce93f6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:38.942298 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9a894-c0d0-4d36-9f92-2d8420ce93f6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:38.959505 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:38.980903 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff103f1-1815-4581-9a85-2d7ad8cebe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:38.981524 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff103f1-1815-4581-9a85-2d7ad8cebe8a None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:38.981800 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff103f1-1815-4581-9a85-2d7ad8cebe8a None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:38.982072 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff103f1-1815-4581-9a85-2d7ad8cebe8a None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:38.982771 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff103f1-1815-4581-9a85-2d7ad8cebe8a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:38.983081 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff103f1-1815-4581-9a85-2d7ad8cebe8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:38.984486 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff103f1-1815-4581-9a85-2d7ad8cebe8a None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:38.989560 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 383/775] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:59:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:38.995830 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022db314-01ac-4d6d-8bd3-ae9043fc6e39 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:39.086003 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:39.093536 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022db314-01ac-4d6d-8bd3-ae9043fc6e39 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:39.127308 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbd9bc-c7fb-4f32-b174-aa84066d03a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:39.127916 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbd9bc-c7fb-4f32-b174-aa84066d03a3 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:39.128193 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbd9bc-c7fb-4f32-b174-aa84066d03a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:39.128464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbd9bc-c7fb-4f32-b174-aa84066d03a3 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:39.129118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbd9bc-c7fb-4f32-b174-aa84066d03a3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:39.129420 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbd9bc-c7fb-4f32-b174-aa84066d03a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:39.130796 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbd9bc-c7fb-4f32-b174-aa84066d03a3 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:39.135747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 393/776] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:59:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:39.141578 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff103f1-1815-4581-9a85-2d7ad8cebe8a None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:39.240914 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff103f1-1815-4581-9a85-2d7ad8cebe8a None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:39.273249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1196f-82be-4068-b3d8-d5d561ecf3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:39.273858 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1196f-82be-4068-b3d8-d5d561ecf3bd None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:39.274133 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1196f-82be-4068-b3d8-d5d561ecf3bd None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:39.274401 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1196f-82be-4068-b3d8-d5d561ecf3bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:39.275167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1196f-82be-4068-b3d8-d5d561ecf3bd None admin] RBAC: Adding query filter params (interface=public, service_id=3c3c4133c63a41d998fd97c796083093, region_id=RegionOne) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:39.275470 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1196f-82be-4068-b3d8-d5d561ecf3bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:39.277341 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1196f-82be-4068-b3d8-d5d561ecf3bd None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:39.282259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 384/777] 10.222.0.65 () {56 vars in 1251 bytes} [Mon Jul 25 23:59:39 2022] GET /identity/v3/endpoints?service_id=3c3c4133c63a41d998fd97c796083093&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:39.287869 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbd9bc-c7fb-4f32-b174-aa84066d03a3 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:39.388491 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbd9bc-c7fb-4f32-b174-aa84066d03a3 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:39.421333 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e91c4-9248-4349-880d-15fbf9f9f107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:39.421971 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e91c4-9248-4349-880d-15fbf9f9f107 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:39.422254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e91c4-9248-4349-880d-15fbf9f9f107 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:39.422529 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e91c4-9248-4349-880d-15fbf9f9f107 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:39.423218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e91c4-9248-4349-880d-15fbf9f9f107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:39.424582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e91c4-9248-4349-880d-15fbf9f9f107 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:39.430733 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 394/778] 10.222.0.65 () {56 vars in 1087 bytes} [Mon Jul 25 23:59:39 2022] GET /identity/v3/services => generated 1498 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 23:59:40.977526 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae581739-0da8-4a38-b83d-2ddd5469b271 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:40.978040 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae581739-0da8-4a38-b83d-2ddd5469b271 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:40.978127 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae581739-0da8-4a38-b83d-2ddd5469b271 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:40.979439 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 385/779] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:40.985368 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39742ea9-be18-4fc7-bdc3-c4b974790823 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:40.985823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39742ea9-be18-4fc7-bdc3-c4b974790823 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:40.985903 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39742ea9-be18-4fc7-bdc3-c4b974790823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:41.004378 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-39742ea9-be18-4fc7-bdc3-c4b974790823 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:41.005538 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-39742ea9-be18-4fc7-bdc3-c4b974790823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:41.021557 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:41.071653 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 395/780] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:40 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:59:41.095150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae581739-0da8-4a38-b83d-2ddd5469b271 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:41.141934 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:41.197197 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae581739-0da8-4a38-b83d-2ddd5469b271 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:41.232726 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8a5cb-626c-4b97-b0d7-a53474d0edf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:41.233281 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a5cb-626c-4b97-b0d7-a53474d0edf9 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:41.233559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a5cb-626c-4b97-b0d7-a53474d0edf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:41.233832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a5cb-626c-4b97-b0d7-a53474d0edf9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:41.234443 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8a5cb-626c-4b97-b0d7-a53474d0edf9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:41.235861 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8a5cb-626c-4b97-b0d7-a53474d0edf9 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-3df8a5cb-626c-4b97-b0d7-a53474d0edf9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:41.244639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:41.246194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 23:59:41.247050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:41.248195 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 386/781] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Jul 25 23:59:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:41.252435 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39742ea9-be18-4fc7-bdc3-c4b974790823 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:41.348708 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39742ea9-be18-4fc7-bdc3-c4b974790823 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:41.382380 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248920-aade-4567-a50d-c43e9e78441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:41.383033 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248920-aade-4567-a50d-c43e9e78441b None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:41.383310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248920-aade-4567-a50d-c43e9e78441b None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:41.383579 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248920-aade-4567-a50d-c43e9e78441b None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:41.384237 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6248920-aade-4567-a50d-c43e9e78441b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:41.384537 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6248920-aade-4567-a50d-c43e9e78441b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:41.385889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6248920-aade-4567-a50d-c43e9e78441b None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:41.391469 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 396/782] 10.222.0.65 () {56 vars in 1126 bytes} [Mon Jul 25 23:59:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:41.396748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8a5cb-626c-4b97-b0d7-a53474d0edf9 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:41.499064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8a5cb-626c-4b97-b0d7-a53474d0edf9 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:41.509108 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:41.535655 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c85b71-cb9c-4868-807d-b079993c08c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:41.536268 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c85b71-cb9c-4868-807d-b079993c08c1 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:41.536543 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c85b71-cb9c-4868-807d-b079993c08c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:41.536811 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c85b71-cb9c-4868-807d-b079993c08c1 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:41.537500 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c85b71-cb9c-4868-807d-b079993c08c1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:41.538072 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c85b71-cb9c-4868-807d-b079993c08c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:41.539470 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c85b71-cb9c-4868-807d-b079993c08c1 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:41.544295 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 387/783] 10.222.0.65 () {56 vars in 1126 bytes} [Mon Jul 25 23:59:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:41.549843 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248920-aade-4567-a50d-c43e9e78441b None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:41.568491 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:41.650267 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248920-aade-4567-a50d-c43e9e78441b None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:41.651486 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9544-c8ab-414f-a3ca-d38c8c76ce27 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:41.651910 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9544-c8ab-414f-a3ca-d38c8c76ce27 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:41.652193 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae9544-c8ab-414f-a3ca-d38c8c76ce27 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:41.653603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 388/784] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 23:59:41.658467 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c910ad1-b165-4bf5-abe1-6a12b5d15221 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:41.658776 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c910ad1-b165-4bf5-abe1-6a12b5d15221 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:41.659057 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c910ad1-b165-4bf5-abe1-6a12b5d15221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:41.677114 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-3c910ad1-b165-4bf5-abe1-6a12b5d15221 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:41.678439 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-3c910ad1-b165-4bf5-abe1-6a12b5d15221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:41.685157 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d4849-37c6-40c8-8ffd-57bc0db2fb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:41.685771 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4849-37c6-40c8-8ffd-57bc0db2fb1a None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:41.686048 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4849-37c6-40c8-8ffd-57bc0db2fb1a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:41.686324 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4849-37c6-40c8-8ffd-57bc0db2fb1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:41.687059 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d4849-37c6-40c8-8ffd-57bc0db2fb1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:41.688416 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d4849-37c6-40c8-8ffd-57bc0db2fb1a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:41.708645 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 397/785] 10.222.0.65 () {60 vars in 1144 bytes} [Mon Jul 25 23:59:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 23:59:41.757940 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 389/786] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:41 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:59:41.783088 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d4849-37c6-40c8-8ffd-57bc0db2fb1a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:41.860058 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:41.904253 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d4849-37c6-40c8-8ffd-57bc0db2fb1a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:41.942111 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24963b26-814f-4c37-b8a6-a7634a93e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:41.943067 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24963b26-814f-4c37-b8a6-a7634a93e7ea None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:41.943585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24963b26-814f-4c37-b8a6-a7634a93e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:41.944011 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24963b26-814f-4c37-b8a6-a7634a93e7ea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:41.944772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24963b26-814f-4c37-b8a6-a7634a93e7ea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:41.946279 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24963b26-814f-4c37-b8a6-a7634a93e7ea None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-24963b26-814f-4c37-b8a6-a7634a93e7ea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:41.955721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:41.956786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 23:59:41.957626 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:41.960058 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 398/787] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:59:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:41.967817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c910ad1-b165-4bf5-abe1-6a12b5d15221 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:42.068565 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:42.072489 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c910ad1-b165-4bf5-abe1-6a12b5d15221 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:42.108496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bbbee-b55a-4000-b782-fe321752f8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:42.109119 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bbbee-b55a-4000-b782-fe321752f8a1 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:42.109401 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bbbee-b55a-4000-b782-fe321752f8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:42.109677 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bbbee-b55a-4000-b782-fe321752f8a1 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:42.110355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bbbee-b55a-4000-b782-fe321752f8a1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:42.110660 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bbbee-b55a-4000-b782-fe321752f8a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:42.112071 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bbbee-b55a-4000-b782-fe321752f8a1 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:42.117091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 390/788] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:59:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:42.123886 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24963b26-814f-4c37-b8a6-a7634a93e7ea None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:42.234323 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24963b26-814f-4c37-b8a6-a7634a93e7ea None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:42.267689 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910ad67-392e-42d8-9cf6-efe3a5718d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:42.268297 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910ad67-392e-42d8-9cf6-efe3a5718d5f None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:42.268576 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910ad67-392e-42d8-9cf6-efe3a5718d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:42.268847 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910ad67-392e-42d8-9cf6-efe3a5718d5f None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:42.269508 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910ad67-392e-42d8-9cf6-efe3a5718d5f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:42.269811 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910ad67-392e-42d8-9cf6-efe3a5718d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:42.271233 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910ad67-392e-42d8-9cf6-efe3a5718d5f None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:42.273207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:42.277065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 399/789] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Jul 25 23:59:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 23:59:42.283253 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bbbee-b55a-4000-b782-fe321752f8a1 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:42.381028 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bbbee-b55a-4000-b782-fe321752f8a1 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:42.415039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a92fa-7bb5-4cbc-9ea5-d2bb10c513cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:42.415659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a92fa-7bb5-4cbc-9ea5-d2bb10c513cf None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:42.415943 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a92fa-7bb5-4cbc-9ea5-d2bb10c513cf None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:42.416221 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a92fa-7bb5-4cbc-9ea5-d2bb10c513cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:42.416934 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a92fa-7bb5-4cbc-9ea5-d2bb10c513cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:42.418557 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a92fa-7bb5-4cbc-9ea5-d2bb10c513cf None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:42.439500 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 391/790] 10.222.0.65 () {60 vars in 1144 bytes} [Mon Jul 25 23:59:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:59:43.988492 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e16ae-c269-4775-ac29-9aebe543f800 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:43.988872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e16ae-c269-4775-ac29-9aebe543f800 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:43.989042 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e16ae-c269-4775-ac29-9aebe543f800 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:43.990558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 400/791] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:43.996208 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83600e25-ec10-4843-950d-c7b2fc15eba1 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:43.996742 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83600e25-ec10-4843-950d-c7b2fc15eba1 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:43.996852 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83600e25-ec10-4843-950d-c7b2fc15eba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:44.015099 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-83600e25-ec10-4843-950d-c7b2fc15eba1 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:44.016279 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-83600e25-ec10-4843-950d-c7b2fc15eba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:44.029839 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:44.088922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 392/792] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:43 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 23:59:44.111908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e16ae-c269-4775-ac29-9aebe543f800 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:44.212442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e16ae-c269-4775-ac29-9aebe543f800 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:44.247158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39636-9438-4078-af12-1c3ebaf33921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:44.247709 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39636-9438-4078-af12-1c3ebaf33921 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:44.247986 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39636-9438-4078-af12-1c3ebaf33921 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:44.248254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39636-9438-4078-af12-1c3ebaf33921 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:44.248865 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e39636-9438-4078-af12-1c3ebaf33921 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:44.250216 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e39636-9438-4078-af12-1c3ebaf33921 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-69e39636-9438-4078-af12-1c3ebaf33921 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:44.258973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:44.260057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:44.260876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 401/793] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:44.266098 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83600e25-ec10-4843-950d-c7b2fc15eba1 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:44.362387 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83600e25-ec10-4843-950d-c7b2fc15eba1 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:44.395159 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a1aaf-b28f-4cd9-a20c-e6d555eb80f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:44.395767 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1aaf-b28f-4cd9-a20c-e6d555eb80f8 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:44.396045 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1aaf-b28f-4cd9-a20c-e6d555eb80f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:44.396318 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1aaf-b28f-4cd9-a20c-e6d555eb80f8 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:44.396977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a1aaf-b28f-4cd9-a20c-e6d555eb80f8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:44.397275 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a1aaf-b28f-4cd9-a20c-e6d555eb80f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:44.398646 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a1aaf-b28f-4cd9-a20c-e6d555eb80f8 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:44.403716 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 393/794] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:44.409480 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39636-9438-4078-af12-1c3ebaf33921 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:44.471122 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:44.511966 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39636-9438-4078-af12-1c3ebaf33921 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:44.549140 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1eb9c-1e8a-4494-9d19-9cc7f38f4f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:44.549755 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1eb9c-1e8a-4494-9d19-9cc7f38f4f82 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:44.550032 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1eb9c-1e8a-4494-9d19-9cc7f38f4f82 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:44.550309 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1eb9c-1e8a-4494-9d19-9cc7f38f4f82 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:44.551005 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1eb9c-1e8a-4494-9d19-9cc7f38f4f82 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:44.551310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1eb9c-1e8a-4494-9d19-9cc7f38f4f82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:44.552673 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1eb9c-1e8a-4494-9d19-9cc7f38f4f82 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:44.557314 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 402/795] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:44.679578 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b14447-1825-4825-9b93-738db05e6259 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:44.679924 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b14447-1825-4825-9b93-738db05e6259 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:44.680211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b14447-1825-4825-9b93-738db05e6259 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:44.681638 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 394/796] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:44.688134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c217a-91e2-4b2b-83ed-8d39b30a92e3 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:44.688418 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c217a-91e2-4b2b-83ed-8d39b30a92e3 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:44.688689 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c217a-91e2-4b2b-83ed-8d39b30a92e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:44.707255 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-5c3c217a-91e2-4b2b-83ed-8d39b30a92e3 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:44.708458 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-5c3c217a-91e2-4b2b-83ed-8d39b30a92e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:44.778502 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 403/797] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:44 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:59:44.802595 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b14447-1825-4825-9b93-738db05e6259 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:44.814490 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:44.905241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b14447-1825-4825-9b93-738db05e6259 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:44.939375 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0477caf-2e49-42ba-adb9-889dcc325573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:44.939978 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0477caf-2e49-42ba-adb9-889dcc325573 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:44.940259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0477caf-2e49-42ba-adb9-889dcc325573 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:44.940529 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0477caf-2e49-42ba-adb9-889dcc325573 None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:44.941197 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0477caf-2e49-42ba-adb9-889dcc325573 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:44.942611 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0477caf-2e49-42ba-adb9-889dcc325573 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:44.945202 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: WARNING keystone.server.flask.common [None req-b0477caf-2e49-42ba-adb9-889dcc325573 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 23:59:44.963863 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.sql.core [None req-b0477caf-2e49-42ba-adb9-889dcc325573 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 23:59:44.963863 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 23:59:44.963863 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [parameters: {'id': '84dc5d1be7f34eabb097f80022dcdd87', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 23:59:44.963863 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87309) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-b0477caf-2e49-42ba-adb9-889dcc325573 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 84dc5d1be7f34eabb097f80022dcdd87.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 84dc5d1be7f34eabb097f80022dcdd87. Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application conn.query(q) Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 23:59:44.981025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application result.read() Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 23:59:44.982094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application next(self.gen) Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application yield resource Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application next(self.gen) Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise self.value Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application session.commit() Jul 25 23:59:44.983386 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self.session.flush() Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application compat.raise_( Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 23:59:44.984366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 23:59:44.985359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application conn.query(q) Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application result.read() Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 23:59:44.986220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [parameters: {'id': '84dc5d1be7f34eabb097f80022dcdd87', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:44.987759 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:44.988785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:44.990041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:44.990041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 23:59:44.990041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 23:59:44.990041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:44.990041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:44.990041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 23:59:44.990041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 23:59:44.990041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 84dc5d1be7f34eabb097f80022dcdd87. Jul 25 23:59:44.990041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:44.990041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 395/798] 10.222.0.65 () {60 vars in 1140 bytes} [Mon Jul 25 23:59:44 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:44.992284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c217a-91e2-4b2b-83ed-8d39b30a92e3 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:45.049197 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:45.091546 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c217a-91e2-4b2b-83ed-8d39b30a92e3 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:45.125196 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d08592-e850-4bce-9cf0-8da3d1febe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:45.125831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d08592-e850-4bce-9cf0-8da3d1febe55 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:45.126113 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d08592-e850-4bce-9cf0-8da3d1febe55 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:45.126384 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d08592-e850-4bce-9cf0-8da3d1febe55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:45.132998 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d08592-e850-4bce-9cf0-8da3d1febe55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:45.134428 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d08592-e850-4bce-9cf0-8da3d1febe55 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-61d08592-e850-4bce-9cf0-8da3d1febe55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 23:59:45.146099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:45.147143 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:45.148593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 23:59:45.148593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 23:59:45.148593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 23:59:45.148593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 23:59:45.148593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 23:59:45.148593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 23:59:45.148593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 23:59:45.148593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:45.148593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 404/799] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:45.153444 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0477caf-2e49-42ba-adb9-889dcc325573 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:45.216002 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:45.254375 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0477caf-2e49-42ba-adb9-889dcc325573 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:45.287146 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c548a4b-ade6-4889-a8bc-e44c2903ff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:45.287765 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c548a4b-ade6-4889-a8bc-e44c2903ff11 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:45.288041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c548a4b-ade6-4889-a8bc-e44c2903ff11 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:45.288313 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c548a4b-ade6-4889-a8bc-e44c2903ff11 None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:45.289012 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c548a4b-ade6-4889-a8bc-e44c2903ff11 None admin] RBAC: Adding query filter params (name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:45.289318 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c548a4b-ade6-4889-a8bc-e44c2903ff11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:45.290963 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c548a4b-ade6-4889-a8bc-e44c2903ff11 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:45.311114 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 396/800] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:46.769469 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de426801-ed4b-4df5-bf0d-dab26e72fe3e None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:46.770057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de426801-ed4b-4df5-bf0d-dab26e72fe3e None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:46.770057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de426801-ed4b-4df5-bf0d-dab26e72fe3e None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:46.771357 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 405/801] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:46.777134 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23980c54-bcc4-47fe-81a5-1fed1c747071 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:46.777643 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23980c54-bcc4-47fe-81a5-1fed1c747071 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:46.777762 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23980c54-bcc4-47fe-81a5-1fed1c747071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:46.795995 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-23980c54-bcc4-47fe-81a5-1fed1c747071 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:46.797477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-23980c54-bcc4-47fe-81a5-1fed1c747071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:46.868597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 397/802] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:46 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:59:46.892191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de426801-ed4b-4df5-bf0d-dab26e72fe3e None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:46.998770 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de426801-ed4b-4df5-bf0d-dab26e72fe3e None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:47.016856 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:47.035574 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43a34d-a39f-40e2-b566-308b968478f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:47.036126 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43a34d-a39f-40e2-b566-308b968478f9 None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:47.036413 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43a34d-a39f-40e2-b566-308b968478f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:47.036673 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43a34d-a39f-40e2-b566-308b968478f9 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:47.037362 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43a34d-a39f-40e2-b566-308b968478f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:47.038750 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43a34d-a39f-40e2-b566-308b968478f9 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:47.052993 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 406/803] 10.222.0.65 () {60 vars in 1141 bytes} [Mon Jul 25 23:59:46 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 23:59:47.584566 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ae170-7224-4be9-80b4-a0db2a2f029f None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:47.584854 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ae170-7224-4be9-80b4-a0db2a2f029f None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:47.585133 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ae170-7224-4be9-80b4-a0db2a2f029f None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:47.586530 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 398/804] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:47.592319 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113018f7-45d8-493a-b1a5-76e2a6d2eb93 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:47.592679 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113018f7-45d8-493a-b1a5-76e2a6d2eb93 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:47.592963 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113018f7-45d8-493a-b1a5-76e2a6d2eb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:47.611619 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-113018f7-45d8-493a-b1a5-76e2a6d2eb93 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:47.612803 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-113018f7-45d8-493a-b1a5-76e2a6d2eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:47.685081 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 407/805] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:47 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:59:47.710756 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ae170-7224-4be9-80b4-a0db2a2f029f None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:47.766295 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:47.811696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ae170-7224-4be9-80b4-a0db2a2f029f None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:47.846142 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed727d-66e4-420d-8840-1145909c5b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:47.846686 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed727d-66e4-420d-8840-1145909c5b45 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:47.846997 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed727d-66e4-420d-8840-1145909c5b45 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:47.847275 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed727d-66e4-420d-8840-1145909c5b45 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:47.847954 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed727d-66e4-420d-8840-1145909c5b45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:47.849393 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed727d-66e4-420d-8840-1145909c5b45 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:47.864066 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.sql.core [None req-6bed727d-66e4-420d-8840-1145909c5b45 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 23:59:47.864066 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 23:59:47.864066 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [parameters: {'user_id': 'fa656d47fd064a81b0714abf0aa45c4d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 23:59:47.864066 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87309) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-6bed727d-66e4-420d-8840-1145909c5b45 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application conn.query(q) Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application result.read() Jul 25 23:59:47.871348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 23:59:47.872351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application next(self.gen) Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application yield resource Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application next(self.gen) Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise self.value Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application session.commit() Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 23:59:47.873337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self.session.flush() Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application compat.raise_( Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 23:59:47.874227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 23:59:47.875160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application conn.query(q) Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application result.read() Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 23:59:47.876019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fa656d47fd064a81b0714abf0aa45c4d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:47.876815 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 23:59:47.877641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 23:59:47.878631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 23:59:47.878631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 23:59:47.878631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 23:59:47.878631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 23:59:47.878631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 23:59:47.878631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:47.878631 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 399/806] 10.222.0.65 () {60 vars in 1131 bytes} [Mon Jul 25 23:59:47 2022] POST /identity/v3/users => generated 160 bytes in 163 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:47.880741 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113018f7-45d8-493a-b1a5-76e2a6d2eb93 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:47.976278 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113018f7-45d8-493a-b1a5-76e2a6d2eb93 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:47.978585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:48.012095 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939b5f0-7399-477b-8197-6792e3d9ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:48.012723 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939b5f0-7399-477b-8197-6792e3d9ab8c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:48.012999 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939b5f0-7399-477b-8197-6792e3d9ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:48.013270 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939b5f0-7399-477b-8197-6792e3d9ab8c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:48.020217 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939b5f0-7399-477b-8197-6792e3d9ab8c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:48.021644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939b5f0-7399-477b-8197-6792e3d9ab8c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-b939b5f0-7399-477b-8197-6792e3d9ab8c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 23:59:48.033644 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:48.039858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:48.041214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:48.041214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:48.041214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 23:59:48.041214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 23:59:48.041214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 23:59:48.041214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 23:59:48.041214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 23:59:48.041214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 23:59:48.041214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 23:59:48.041214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:48.041214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 408/807] 10.222.0.65 () {56 vars in 1099 bytes} [Mon Jul 25 23:59:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:48.042069 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed727d-66e4-420d-8840-1145909c5b45 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:48.142529 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed727d-66e4-420d-8840-1145909c5b45 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:48.158861 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:48.177859 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94d9af-8525-47d5-8354-e3a5376a0d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:48.178477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94d9af-8525-47d5-8354-e3a5376a0d92 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:48.178795 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94d9af-8525-47d5-8354-e3a5376a0d92 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:48.179077 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94d9af-8525-47d5-8354-e3a5376a0d92 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:48.180097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94d9af-8525-47d5-8354-e3a5376a0d92 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:48.180403 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94d9af-8525-47d5-8354-e3a5376a0d92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:48.182026 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94d9af-8525-47d5-8354-e3a5376a0d92 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:48.221302 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 400/808] 10.222.0.65 () {56 vars in 1101 bytes} [Mon Jul 25 23:59:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:49.295770 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cad8f-fa2f-4d7a-8292-109e21dcfe5d None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:49.296303 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cad8f-fa2f-4d7a-8292-109e21dcfe5d None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:49.296303 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cad8f-fa2f-4d7a-8292-109e21dcfe5d None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:49.297652 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 409/809] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:49.302736 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c787f-6be2-49ba-a0bd-5ac270d7b1d4 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:49.303156 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c787f-6be2-49ba-a0bd-5ac270d7b1d4 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:49.303291 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c787f-6be2-49ba-a0bd-5ac270d7b1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:49.321967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-7a8c787f-6be2-49ba-a0bd-5ac270d7b1d4 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:49.323494 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-7a8c787f-6be2-49ba-a0bd-5ac270d7b1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:49.388312 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 401/810] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:49 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:59:49.411531 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cad8f-fa2f-4d7a-8292-109e21dcfe5d None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:49.511062 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cad8f-fa2f-4d7a-8292-109e21dcfe5d None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:49.543647 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f16c5-b40d-4b0f-8980-5b82563e5d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:49.544264 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f16c5-b40d-4b0f-8980-5b82563e5d18 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:49.544543 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f16c5-b40d-4b0f-8980-5b82563e5d18 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:49.544818 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f16c5-b40d-4b0f-8980-5b82563e5d18 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:49.545425 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f16c5-b40d-4b0f-8980-5b82563e5d18 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:49.546856 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f16c5-b40d-4b0f-8980-5b82563e5d18 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-354f16c5-b40d-4b0f-8980-5b82563e5d18 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:49.555657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:49.556834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 25 23:59:49.557855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 410/811] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:49.562781 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c787f-6be2-49ba-a0bd-5ac270d7b1d4 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:49.656816 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c787f-6be2-49ba-a0bd-5ac270d7b1d4 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:49.659174 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:49.691258 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b76636-1ee0-43b7-b7da-839d3e4f5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:49.691868 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b76636-1ee0-43b7-b7da-839d3e4f5a61 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:49.692148 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b76636-1ee0-43b7-b7da-839d3e4f5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:49.692422 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b76636-1ee0-43b7-b7da-839d3e4f5a61 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:49.693085 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b76636-1ee0-43b7-b7da-839d3e4f5a61 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:49.693387 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b76636-1ee0-43b7-b7da-839d3e4f5a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:49.694784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b76636-1ee0-43b7-b7da-839d3e4f5a61 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:49.699585 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 402/812] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:49.705434 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f16c5-b40d-4b0f-8980-5b82563e5d18 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:49.734284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:49.802876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f16c5-b40d-4b0f-8980-5b82563e5d18 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:49.834604 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0be836-2bc2-43e6-b080-df5c3d15b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:49.835223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0be836-2bc2-43e6-b080-df5c3d15b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:49.835497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0be836-2bc2-43e6-b080-df5c3d15b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:49.835763 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0be836-2bc2-43e6-b080-df5c3d15b2e4 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:49.836409 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0be836-2bc2-43e6-b080-df5c3d15b2e4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:49.836705 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0be836-2bc2-43e6-b080-df5c3d15b2e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:49.838046 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0be836-2bc2-43e6-b080-df5c3d15b2e4 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:49.843301 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 411/813] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:49.849088 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b76636-1ee0-43b7-b7da-839d3e4f5a61 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:49.947891 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b76636-1ee0-43b7-b7da-839d3e4f5a61 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:49.982927 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d6dd4-c750-4937-8b09-4b8a4d234a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:49.983552 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6dd4-c750-4937-8b09-4b8a4d234a01 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:49.983833 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6dd4-c750-4937-8b09-4b8a4d234a01 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:49.984109 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6dd4-c750-4937-8b09-4b8a4d234a01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:49.984859 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d6dd4-c750-4937-8b09-4b8a4d234a01 None admin] RBAC: Adding query filter params (interface=public, service_id=4f3b6850443042109579c12d4d3585b3, region_id=RegionOne) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:49.985167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d6dd4-c750-4937-8b09-4b8a4d234a01 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:49.986535 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d6dd4-c750-4937-8b09-4b8a4d234a01 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:49.991592 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 403/814] 10.222.0.65 () {56 vars in 1251 bytes} [Mon Jul 25 23:59:49 2022] GET /identity/v3/endpoints?service_id=4f3b6850443042109579c12d4d3585b3&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:49.997267 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0be836-2bc2-43e6-b080-df5c3d15b2e4 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:50.085261 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:50.094604 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0be836-2bc2-43e6-b080-df5c3d15b2e4 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:50.126791 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375188e2-191f-413f-ad9e-eb574801233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:50.127385 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375188e2-191f-413f-ad9e-eb574801233a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:50.127661 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375188e2-191f-413f-ad9e-eb574801233a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:50.127929 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375188e2-191f-413f-ad9e-eb574801233a None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:50.128553 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375188e2-191f-413f-ad9e-eb574801233a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:50.129904 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375188e2-191f-413f-ad9e-eb574801233a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:50.136466 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 412/815] 10.222.0.65 () {56 vars in 1087 bytes} [Mon Jul 25 23:59:49 2022] GET /identity/v3/services => generated 1728 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 23:59:52.358865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84969bf1-a784-4254-9997-b85b93cb2519 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:52.359412 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84969bf1-a784-4254-9997-b85b93cb2519 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:52.359412 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84969bf1-a784-4254-9997-b85b93cb2519 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:52.360748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 404/816] 10.222.0.65 () {54 vars in 926 bytes} [Mon Jul 25 23:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:59:52.365951 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97b2d7-36ab-43d4-a1d9-14b64d87a7d5 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:52.366358 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97b2d7-36ab-43d4-a1d9-14b64d87a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:52.366504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97b2d7-36ab-43d4-a1d9-14b64d87a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:52.385393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-2b97b2d7-36ab-43d4-a1d9-14b64d87a7d5 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:59:52.386696 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-2b97b2d7-36ab-43d4-a1d9-14b64d87a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:59:52.452256 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 413/817] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Jul 25 23:59:52 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 23:59:52.475565 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84969bf1-a784-4254-9997-b85b93cb2519 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:52.507634 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:52.578104 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84969bf1-a784-4254-9997-b85b93cb2519 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:52.611574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c00c5-cab0-4cb9-8a64-5a66cae02cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:52.612140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c00c5-cab0-4cb9-8a64-5a66cae02cd1 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:52.612417 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c00c5-cab0-4cb9-8a64-5a66cae02cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:52.612689 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c00c5-cab0-4cb9-8a64-5a66cae02cd1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:52.613297 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c00c5-cab0-4cb9-8a64-5a66cae02cd1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:52.614661 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c00c5-cab0-4cb9-8a64-5a66cae02cd1 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-4c8c00c5-cab0-4cb9-8a64-5a66cae02cd1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 23:59:52.623419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 23:59:52.624600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 25 23:59:52.625648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 405/818] 10.222.0.65 () {56 vars in 1111 bytes} [Mon Jul 25 23:59:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 23:59:52.630461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97b2d7-36ab-43d4-a1d9-14b64d87a7d5 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:52.719779 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:52.735290 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97b2d7-36ab-43d4-a1d9-14b64d87a7d5 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:52.767954 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf0984-c3a0-470e-ab21-12ec3cb5f67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:52.768579 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf0984-c3a0-470e-ab21-12ec3cb5f67a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:52.768863 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf0984-c3a0-470e-ab21-12ec3cb5f67a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:52.769141 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf0984-c3a0-470e-ab21-12ec3cb5f67a None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:52.769802 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf0984-c3a0-470e-ab21-12ec3cb5f67a None admin] RBAC: Adding query filter params (name=compute) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:52.770107 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf0984-c3a0-470e-ab21-12ec3cb5f67a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:52.771496 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf0984-c3a0-470e-ab21-12ec3cb5f67a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:52.776167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 414/819] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:52.782466 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c00c5-cab0-4cb9-8a64-5a66cae02cd1 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:52.875265 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:59:52.881462 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c00c5-cab0-4cb9-8a64-5a66cae02cd1 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:52.914399 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0169c4-3dea-4f30-a9ff-1e83a37c1298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:52.915033 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0169c4-3dea-4f30-a9ff-1e83a37c1298 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:52.915316 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0169c4-3dea-4f30-a9ff-1e83a37c1298 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:52.915590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0169c4-3dea-4f30-a9ff-1e83a37c1298 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:52.916252 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0169c4-3dea-4f30-a9ff-1e83a37c1298 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 23:59:52.916558 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0169c4-3dea-4f30-a9ff-1e83a37c1298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:52.917941 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0169c4-3dea-4f30-a9ff-1e83a37c1298 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:52.922579 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 406/820] 10.222.0.65 () {56 vars in 1112 bytes} [Mon Jul 25 23:59:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 23:59:52.928234 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf0984-c3a0-470e-ab21-12ec3cb5f67a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:59:53.025773 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf0984-c3a0-470e-ab21-12ec3cb5f67a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:59:53.058848 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2ec24-8dea-4927-a2d4-0a49beeeb46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:59:53.059448 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2ec24-8dea-4927-a2d4-0a49beeeb46a None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:59:53.059722 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2ec24-8dea-4927-a2d4-0a49beeeb46a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:59:53.059990 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2ec24-8dea-4927-a2d4-0a49beeeb46a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:59:53.060715 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2ec24-8dea-4927-a2d4-0a49beeeb46a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:59:53.062065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2ec24-8dea-4927-a2d4-0a49beeeb46a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:59:53.080991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 415/821] 10.222.0.65 () {60 vars in 1144 bytes} [Mon Jul 25 23:59:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 00:00:02.920234 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=20 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:03.077005 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=96,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:54.397922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0a2c9-264c-48a4-91b0-15ae614b0cc9 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:54.398661 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0a2c9-264c-48a4-91b0-15ae614b0cc9 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:54.398661 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0a2c9-264c-48a4-91b0-15ae614b0cc9 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:54.399858 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 407/822] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 00:00:54.407425 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ab79a-e780-445f-83f0-3ae7d3c4bbe5 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:54.407991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ab79a-e780-445f-83f0-3ae7d3c4bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:54.408179 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ab79a-e780-445f-83f0-3ae7d3c4bbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:54.430553 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-707ab79a-e780-445f-83f0-3ae7d3c4bbe5 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:00:54.432006 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-707ab79a-e780-445f-83f0-3ae7d3c4bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:00:54.522048 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 416/823] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:00:54 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 00:00:54.555157 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0a2c9-264c-48a4-91b0-15ae614b0cc9 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:54.679670 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0a2c9-264c-48a4-91b0-15ae614b0cc9 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:54.724113 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201ce10-adff-40b5-8f7d-94908b825428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:54.725118 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201ce10-adff-40b5-8f7d-94908b825428 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:54.725527 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201ce10-adff-40b5-8f7d-94908b825428 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:54.725886 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201ce10-adff-40b5-8f7d-94908b825428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:54.738974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201ce10-adff-40b5-8f7d-94908b825428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:54.740413 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201ce10-adff-40b5-8f7d-94908b825428 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-5201ce10-adff-40b5-8f7d-94908b825428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:00:54.757272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:00:54.759110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:00:54.762206 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:00:54.762206 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:00:54.762206 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:00:54.762206 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:00:54.762206 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 408/824] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:00:54.768781 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ab79a-e780-445f-83f0-3ae7d3c4bbe5 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:54.904304 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ab79a-e780-445f-83f0-3ae7d3c4bbe5 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:54.937785 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:54.951893 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3002c-c57e-483b-98e4-3c0db6f61f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:54.952649 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3002c-c57e-483b-98e4-3c0db6f61f01 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:54.952971 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3002c-c57e-483b-98e4-3c0db6f61f01 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:54.953274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3002c-c57e-483b-98e4-3c0db6f61f01 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:54.954058 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3002c-c57e-483b-98e4-3c0db6f61f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:00:54.954408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3002c-c57e-483b-98e4-3c0db6f61f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:54.955941 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3002c-c57e-483b-98e4-3c0db6f61f01 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:54.970620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 417/825] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 00:00:54.977253 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201ce10-adff-40b5-8f7d-94908b825428 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:55.044858 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:55.102749 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201ce10-adff-40b5-8f7d-94908b825428 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:55.145045 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f0cf7-65c6-4ac2-889e-7c71d261e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:55.145776 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0cf7-65c6-4ac2-889e-7c71d261e086 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:55.146130 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0cf7-65c6-4ac2-889e-7c71d261e086 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:55.146474 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0cf7-65c6-4ac2-889e-7c71d261e086 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:55.147217 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f0cf7-65c6-4ac2-889e-7c71d261e086 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:55.148672 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f0cf7-65c6-4ac2-889e-7c71d261e086 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:55.173520 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 409/826] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Jul 26 00:00:54 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 00:00:57.616536 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54641d-2d09-4b9e-bc87-db937565d3d4 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:57.617093 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54641d-2d09-4b9e-bc87-db937565d3d4 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:57.617093 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54641d-2d09-4b9e-bc87-db937565d3d4 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:57.618753 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 418/827] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:00:57.625253 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d12dd-5561-402f-be19-39000ec4e428 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:57.625678 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d12dd-5561-402f-be19-39000ec4e428 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:57.625809 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d12dd-5561-402f-be19-39000ec4e428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:57.648790 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-ce2d12dd-5561-402f-be19-39000ec4e428 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:00:57.650370 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-ce2d12dd-5561-402f-be19-39000ec4e428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:00:57.737066 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 410/828] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:00:57 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 00:00:57.762334 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54641d-2d09-4b9e-bc87-db937565d3d4 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:57.878906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54641d-2d09-4b9e-bc87-db937565d3d4 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:57.914856 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b36fe-8183-4c94-86da-da5d148c036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:57.915785 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b36fe-8183-4c94-86da-da5d148c036c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:57.916069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b36fe-8183-4c94-86da-da5d148c036c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:57.916346 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b36fe-8183-4c94-86da-da5d148c036c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:57.928426 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b36fe-8183-4c94-86da-da5d148c036c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-d03b36fe-8183-4c94-86da-da5d148c036c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 00:00:57.933605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:00:57.935456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:00:57.936872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 419/829] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Jul 26 00:00:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:00:57.940740 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d12dd-5561-402f-be19-39000ec4e428 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:57.982981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:58.055267 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d12dd-5561-402f-be19-39000ec4e428 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:58.094908 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552599bf-85e4-401e-b179-ca285b3887d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:58.096382 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552599bf-85e4-401e-b179-ca285b3887d6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:58.096784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552599bf-85e4-401e-b179-ca285b3887d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:58.097223 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552599bf-85e4-401e-b179-ca285b3887d6 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:58.098166 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552599bf-85e4-401e-b179-ca285b3887d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:00:58.098641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552599bf-85e4-401e-b179-ca285b3887d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:58.100363 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552599bf-85e4-401e-b179-ca285b3887d6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:58.112689 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 411/830] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Jul 26 00:00:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:00:58.118841 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b36fe-8183-4c94-86da-da5d148c036c None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:58.170041 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:58.227782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b36fe-8183-4c94-86da-da5d148c036c None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:58.264579 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0838f-31a8-48a1-a76c-2fff9e4e05b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:58.265235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0838f-31a8-48a1-a76c-2fff9e4e05b0 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:58.265494 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0838f-31a8-48a1-a76c-2fff9e4e05b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:58.265769 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0838f-31a8-48a1-a76c-2fff9e4e05b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:58.279110 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0838f-31a8-48a1-a76c-2fff9e4e05b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:58.280562 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0838f-31a8-48a1-a76c-2fff9e4e05b0 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-52e0838f-31a8-48a1-a76c-2fff9e4e05b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:00:58.297184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:00:58.298214 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:00:58.299125 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:00:58.299125 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:00:58.299125 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:00:58.299125 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:00:58.299125 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 420/831] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:00:58.304453 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552599bf-85e4-401e-b179-ca285b3887d6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:58.423984 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:58.427319 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552599bf-85e4-401e-b179-ca285b3887d6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:58.465279 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c90e2d-c35b-4818-9c48-5b3fdf7c5cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:58.465930 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c90e2d-c35b-4818-9c48-5b3fdf7c5cec None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:58.466228 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c90e2d-c35b-4818-9c48-5b3fdf7c5cec None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:58.466489 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c90e2d-c35b-4818-9c48-5b3fdf7c5cec None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:58.467205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c90e2d-c35b-4818-9c48-5b3fdf7c5cec None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:00:58.467541 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c90e2d-c35b-4818-9c48-5b3fdf7c5cec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:58.469156 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c90e2d-c35b-4818-9c48-5b3fdf7c5cec None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:58.484425 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 412/832] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:00:58.490318 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0838f-31a8-48a1-a76c-2fff9e4e05b0 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:58.601969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:58.606618 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0838f-31a8-48a1-a76c-2fff9e4e05b0 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:58.645349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5dd35-6651-4b50-85cb-7585961d578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:58.646053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5dd35-6651-4b50-85cb-7585961d578d None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:58.646325 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5dd35-6651-4b50-85cb-7585961d578d None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:58.646599 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5dd35-6651-4b50-85cb-7585961d578d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:58.655545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5dd35-6651-4b50-85cb-7585961d578d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:58.657141 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5dd35-6651-4b50-85cb-7585961d578d None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-81b5dd35-6651-4b50-85cb-7585961d578d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 00:00:58.671118 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:00:58.672120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:00:58.673257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:00:58.673257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:00:58.673257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 00:00:58.673257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 00:00:58.673257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 00:00:58.673257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 00:00:58.673257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 00:00:58.673257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 00:00:58.673257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 00:00:58.673257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:00:58.673257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 421/833] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:00:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:00:58.679646 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c90e2d-c35b-4818-9c48-5b3fdf7c5cec None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:58.796891 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c90e2d-c35b-4818-9c48-5b3fdf7c5cec None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:58.836256 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bd239-8e75-4777-892f-36316f07906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:58.836877 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bd239-8e75-4777-892f-36316f07906f None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:58.837160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bd239-8e75-4777-892f-36316f07906f None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:58.837438 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bd239-8e75-4777-892f-36316f07906f None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:58.838232 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bd239-8e75-4777-892f-36316f07906f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:00:58.838531 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bd239-8e75-4777-892f-36316f07906f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:58.840840 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bd239-8e75-4777-892f-36316f07906f None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:58.859818 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 413/834] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Jul 26 00:00:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:00:58.865812 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5dd35-6651-4b50-85cb-7585961d578d None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:58.973550 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5dd35-6651-4b50-85cb-7585961d578d None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:59.013620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2d776-dc85-4ac0-b7a0-6cb07cb68b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:59.014239 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2d776-dc85-4ac0-b7a0-6cb07cb68b99 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:59.014538 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2d776-dc85-4ac0-b7a0-6cb07cb68b99 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:59.014917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2d776-dc85-4ac0-b7a0-6cb07cb68b99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:59.043550 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:59.087723 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2d776-dc85-4ac0-b7a0-6cb07cb68b99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:59.090190 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2d776-dc85-4ac0-b7a0-6cb07cb68b99 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:59.197748 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 422/835] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Jul 26 00:00:58 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 00:00:59.204423 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bd239-8e75-4777-892f-36316f07906f None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:59.224223 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:59.310858 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bd239-8e75-4777-892f-36316f07906f None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:59.348121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27482a54-6914-42cd-8ad3-b413041f5ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:59.348764 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27482a54-6914-42cd-8ad3-b413041f5ba7 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:59.349050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27482a54-6914-42cd-8ad3-b413041f5ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:59.349325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27482a54-6914-42cd-8ad3-b413041f5ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:59.359818 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27482a54-6914-42cd-8ad3-b413041f5ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:59.361313 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27482a54-6914-42cd-8ad3-b413041f5ba7 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-27482a54-6914-42cd-8ad3-b413041f5ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:00:59.377495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:00:59.378624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:00:59.379579 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:00:59.379579 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:00:59.379579 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:00:59.379579 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:00:59.379579 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 414/836] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:00:59.384810 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2d776-dc85-4ac0-b7a0-6cb07cb68b99 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:59.450741 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:59.496708 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2d776-dc85-4ac0-b7a0-6cb07cb68b99 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:59.534664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2943359-ef24-48fd-9a03-b85a31fc1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:59.535180 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2943359-ef24-48fd-9a03-b85a31fc1bda None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:59.535565 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2943359-ef24-48fd-9a03-b85a31fc1bda None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:59.535998 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2943359-ef24-48fd-9a03-b85a31fc1bda None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:59.536707 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2943359-ef24-48fd-9a03-b85a31fc1bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:00:59.537080 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2943359-ef24-48fd-9a03-b85a31fc1bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:59.538493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2943359-ef24-48fd-9a03-b85a31fc1bda None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:59.550509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 423/837] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:00:59.556843 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27482a54-6914-42cd-8ad3-b413041f5ba7 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:59.633509 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:59.670689 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27482a54-6914-42cd-8ad3-b413041f5ba7 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:59.709730 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391aca4-f4ae-4169-a27d-3d130787e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:59.710419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391aca4-f4ae-4169-a27d-3d130787e868 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:59.710636 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391aca4-f4ae-4169-a27d-3d130787e868 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:59.711022 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391aca4-f4ae-4169-a27d-3d130787e868 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:59.718300 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391aca4-f4ae-4169-a27d-3d130787e868 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:59.719804 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391aca4-f4ae-4169-a27d-3d130787e868 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-c391aca4-f4ae-4169-a27d-3d130787e868 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 00:00:59.732078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:00:59.733296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:00:59.734187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 00:00:59.734187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 00:00:59.734187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 00:00:59.734187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 00:00:59.734187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 00:00:59.734187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 00:00:59.734187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 00:00:59.734187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:00:59.734187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 415/838] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Jul 26 00:00:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:00:59.739244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2943359-ef24-48fd-9a03-b85a31fc1bda None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:00:59.850278 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2943359-ef24-48fd-9a03-b85a31fc1bda None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:00:59.871360 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:00:59.892865 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac802b-7a67-4af4-90f7-77f41255dcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:00:59.893479 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac802b-7a67-4af4-90f7-77f41255dcf5 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:00:59.893752 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac802b-7a67-4af4-90f7-77f41255dcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:00:59.894018 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac802b-7a67-4af4-90f7-77f41255dcf5 None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:00:59.894948 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac802b-7a67-4af4-90f7-77f41255dcf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:00:59.895410 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac802b-7a67-4af4-90f7-77f41255dcf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:00:59.897029 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac802b-7a67-4af4-90f7-77f41255dcf5 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:00:59.912141 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 424/839] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Jul 26 00:00:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:00:59.920280 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391aca4-f4ae-4169-a27d-3d130787e868 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:00.036338 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391aca4-f4ae-4169-a27d-3d130787e868 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:00.067564 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:00.074307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef80bdc-b6a3-4cd0-9cb2-ceb2af56064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:00.074994 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef80bdc-b6a3-4cd0-9cb2-ceb2af56064c None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:00.075278 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef80bdc-b6a3-4cd0-9cb2-ceb2af56064c None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:00.075551 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef80bdc-b6a3-4cd0-9cb2-ceb2af56064c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:00.076381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef80bdc-b6a3-4cd0-9cb2-ceb2af56064c None admin] RBAC: Adding query filter params (role.id=6be878a30a464fc38706d4cab9d64f17, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=d88b351fcdad4f2ab1a42e2ac3ee0856) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:00.076691 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef80bdc-b6a3-4cd0-9cb2-ceb2af56064c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:00.078220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef80bdc-b6a3-4cd0-9cb2-ceb2af56064c None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:00.084243 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 416/840] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Jul 26 00:00:59 2022] GET /identity/v3/role_assignments?user.id=d88b351fcdad4f2ab1a42e2ac3ee0856&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=6be878a30a464fc38706d4cab9d64f17 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:02.462633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce385608-cbe1-4702-b3e3-59e5789e6588 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:02.463211 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce385608-cbe1-4702-b3e3-59e5789e6588 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:02.463211 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce385608-cbe1-4702-b3e3-59e5789e6588 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:02.465574 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 425/841] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:01:02.470789 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c79f9f-5cc5-4c88-9dfc-3c6c2a2a14c0 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:02.471215 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c79f9f-5cc5-4c88-9dfc-3c6c2a2a14c0 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:02.471463 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c79f9f-5cc5-4c88-9dfc-3c6c2a2a14c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:02.490893 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-43c79f9f-5cc5-4c88-9dfc-3c6c2a2a14c0 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:01:02.492244 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-43c79f9f-5cc5-4c88-9dfc-3c6c2a2a14c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:01:02.559724 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 417/842] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:01:02 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 00:01:02.583170 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce385608-cbe1-4702-b3e3-59e5789e6588 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:02.701507 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce385608-cbe1-4702-b3e3-59e5789e6588 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:02.740910 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eec0d-dd2a-4e0b-9a15-c8cbf092bbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:02.741548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eec0d-dd2a-4e0b-9a15-c8cbf092bbac None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:02.741827 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eec0d-dd2a-4e0b-9a15-c8cbf092bbac None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:02.742134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eec0d-dd2a-4e0b-9a15-c8cbf092bbac None admin] PATH_INFO: `/v3/roles/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:02.755263 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eec0d-dd2a-4e0b-9a15-c8cbf092bbac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-160eec0d-dd2a-4e0b-9a15-c8cbf092bbac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 00:01:02.761731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:02.762942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:02.764240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 426/843] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Jul 26 00:01:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:02.769397 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c79f9f-5cc5-4c88-9dfc-3c6c2a2a14c0 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:02.889710 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c79f9f-5cc5-4c88-9dfc-3c6c2a2a14c0 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:02.917630 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:02.929829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49658437-f59a-40df-9b9e-e4bb7d52b488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:02.930395 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49658437-f59a-40df-9b9e-e4bb7d52b488 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:02.930683 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49658437-f59a-40df-9b9e-e4bb7d52b488 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:02.931072 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49658437-f59a-40df-9b9e-e4bb7d52b488 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:02.931997 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49658437-f59a-40df-9b9e-e4bb7d52b488 None admin] RBAC: Adding query filter params (name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:02.932344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49658437-f59a-40df-9b9e-e4bb7d52b488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:02.933838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49658437-f59a-40df-9b9e-e4bb7d52b488 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:02.943547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 418/844] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Jul 26 00:01:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:02.950666 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eec0d-dd2a-4e0b-9a15-c8cbf092bbac None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:02.996843 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:03.069116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eec0d-dd2a-4e0b-9a15-c8cbf092bbac None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:03.110545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c77ea-dabd-4727-b088-28f1abc27eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:03.111294 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c77ea-dabd-4727-b088-28f1abc27eb9 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:03.111619 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c77ea-dabd-4727-b088-28f1abc27eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:03.111968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c77ea-dabd-4727-b088-28f1abc27eb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:03.124294 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c77ea-dabd-4727-b088-28f1abc27eb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:03.125975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c77ea-dabd-4727-b088-28f1abc27eb9 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-135c77ea-dabd-4727-b088-28f1abc27eb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:01:03.144166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:03.145254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:03.146163 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:01:03.146163 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:01:03.146163 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:03.146163 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:03.146163 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 427/845] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:03.152606 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49658437-f59a-40df-9b9e-e4bb7d52b488 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:03.272801 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49658437-f59a-40df-9b9e-e4bb7d52b488 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:03.315842 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cda8b4-5c35-4988-8043-1e7a17431546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:03.316461 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cda8b4-5c35-4988-8043-1e7a17431546 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:03.316746 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cda8b4-5c35-4988-8043-1e7a17431546 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:03.317020 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cda8b4-5c35-4988-8043-1e7a17431546 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:03.317709 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cda8b4-5c35-4988-8043-1e7a17431546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:03.318019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cda8b4-5c35-4988-8043-1e7a17431546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:03.319426 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cda8b4-5c35-4988-8043-1e7a17431546 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:03.332234 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 419/846] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:03.337961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c77ea-dabd-4727-b088-28f1abc27eb9 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:03.437937 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:03.448722 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c77ea-dabd-4727-b088-28f1abc27eb9 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:03.486582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3412c68-6681-42e3-a7ac-10de4e97016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:03.487266 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3412c68-6681-42e3-a7ac-10de4e97016b None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:03.487513 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3412c68-6681-42e3-a7ac-10de4e97016b None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:03.487782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3412c68-6681-42e3-a7ac-10de4e97016b None admin] PATH_INFO: `/v3/users/placement` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:03.495421 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3412c68-6681-42e3-a7ac-10de4e97016b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:03.496860 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3412c68-6681-42e3-a7ac-10de4e97016b None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-a3412c68-6681-42e3-a7ac-10de4e97016b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 00:01:03.510322 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:03.512352 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:03.513567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:03.513567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:03.513567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 00:01:03.513567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 00:01:03.513567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 00:01:03.513567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 00:01:03.513567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 00:01:03.513567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 00:01:03.513567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 00:01:03.513567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:03.513567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 428/847] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:03.519524 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cda8b4-5c35-4988-8043-1e7a17431546 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:03.568225 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:03.623416 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cda8b4-5c35-4988-8043-1e7a17431546 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:03.662447 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f6cc4-c23d-4f95-b57e-8061b4426f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:03.663452 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f6cc4-c23d-4f95-b57e-8061b4426f65 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:03.663718 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f6cc4-c23d-4f95-b57e-8061b4426f65 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:03.664037 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f6cc4-c23d-4f95-b57e-8061b4426f65 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:03.664794 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f6cc4-c23d-4f95-b57e-8061b4426f65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:03.665194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f6cc4-c23d-4f95-b57e-8061b4426f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:03.666521 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f6cc4-c23d-4f95-b57e-8061b4426f65 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:03.685296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 420/848] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Jul 26 00:01:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:03.691295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3412c68-6681-42e3-a7ac-10de4e97016b None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:03.808741 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3412c68-6681-42e3-a7ac-10de4e97016b None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:03.847288 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa670f4f-7203-4cfd-8e1b-64b32972edd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:03.847807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa670f4f-7203-4cfd-8e1b-64b32972edd7 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:03.848073 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa670f4f-7203-4cfd-8e1b-64b32972edd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:03.848343 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa670f4f-7203-4cfd-8e1b-64b32972edd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:03.859832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa670f4f-7203-4cfd-8e1b-64b32972edd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:03.861253 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa670f4f-7203-4cfd-8e1b-64b32972edd7 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-aa670f4f-7203-4cfd-8e1b-64b32972edd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:01:03.878823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:03.879969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:03.881072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:01:03.881072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:01:03.881072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:03.881072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:03.881072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 429/849] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 00:01:03.885741 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f6cc4-c23d-4f95-b57e-8061b4426f65 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:04.007144 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f6cc4-c23d-4f95-b57e-8061b4426f65 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:04.010780 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:04.056806 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff36e96-0887-4b09-98ca-997bd386ca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:04.057422 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff36e96-0887-4b09-98ca-997bd386ca7c None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:04.057976 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff36e96-0887-4b09-98ca-997bd386ca7c None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:04.058364 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff36e96-0887-4b09-98ca-997bd386ca7c None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:04.059065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff36e96-0887-4b09-98ca-997bd386ca7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:04.059379 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff36e96-0887-4b09-98ca-997bd386ca7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:04.060768 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff36e96-0887-4b09-98ca-997bd386ca7c None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:04.075183 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 421/850] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:04.080932 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa670f4f-7203-4cfd-8e1b-64b32972edd7 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:04.083968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:04.195107 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa670f4f-7203-4cfd-8e1b-64b32972edd7 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:04.235755 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcb5c0-4655-4c79-a89e-927d1b2bdc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:04.236398 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb5c0-4655-4c79-a89e-927d1b2bdc89 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:04.236710 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb5c0-4655-4c79-a89e-927d1b2bdc89 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:04.237111 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcb5c0-4655-4c79-a89e-927d1b2bdc89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:04.245136 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcb5c0-4655-4c79-a89e-927d1b2bdc89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:04.246968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcb5c0-4655-4c79-a89e-927d1b2bdc89 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-76fcb5c0-4655-4c79-a89e-927d1b2bdc89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 00:01:04.258284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:04.259464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:04.261132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 00:01:04.261132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 00:01:04.261132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 00:01:04.261132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 00:01:04.261132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 00:01:04.261132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 00:01:04.261132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 00:01:04.261132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:04.261132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 430/851] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Jul 26 00:01:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:04.266820 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff36e96-0887-4b09-98ca-997bd386ca7c None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:04.380928 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff36e96-0887-4b09-98ca-997bd386ca7c None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:04.419656 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df8bbd-7069-4f68-84b1-ce5d0829a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:04.420274 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df8bbd-7069-4f68-84b1-ce5d0829a162 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:04.420556 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df8bbd-7069-4f68-84b1-ce5d0829a162 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:04.420837 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df8bbd-7069-4f68-84b1-ce5d0829a162 None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:04.421573 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df8bbd-7069-4f68-84b1-ce5d0829a162 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:04.421885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df8bbd-7069-4f68-84b1-ce5d0829a162 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:04.423359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df8bbd-7069-4f68-84b1-ce5d0829a162 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:04.437130 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 422/852] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Jul 26 00:01:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:04.444514 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcb5c0-4655-4c79-a89e-927d1b2bdc89 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:04.514445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:04.556378 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcb5c0-4655-4c79-a89e-927d1b2bdc89 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:04.594280 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383d9ca-6ea0-4b58-b506-ef661fcdc6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:04.594280 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383d9ca-6ea0-4b58-b506-ef661fcdc6ea None admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:04.594280 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383d9ca-6ea0-4b58-b506-ef661fcdc6ea None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:04.594280 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383d9ca-6ea0-4b58-b506-ef661fcdc6ea None admin] PATH_INFO: `/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/d88b351fcdad4f2ab1a42e2ac3ee0856/roles/6be878a30a464fc38706d4cab9d64f17` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:04.612280 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383d9ca-6ea0-4b58-b506-ef661fcdc6ea None admin] RBAC: Authorizing `identity:create_grant(project_id=4d685fe7e12e4d86a5d5db9253e7e11f, user_id=d88b351fcdad4f2ab1a42e2ac3ee0856, role_id=6be878a30a464fc38706d4cab9d64f17)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:04.613684 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383d9ca-6ea0-4b58-b506-ef661fcdc6ea None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:04.625562 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 431/853] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Jul 26 00:01:04 2022] PUT /identity/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/d88b351fcdad4f2ab1a42e2ac3ee0856/roles/6be878a30a464fc38706d4cab9d64f17 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:01:07.154303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2fc67-d4c1-458d-9482-8f6510e0c3af None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:07.154894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2fc67-d4c1-458d-9482-8f6510e0c3af None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:07.155005 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2fc67-d4c1-458d-9482-8f6510e0c3af None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:07.157111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 423/854] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:01:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:01:07.162382 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb25cec-1709-430f-92a2-f774d173ff03 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:07.162943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb25cec-1709-430f-92a2-f774d173ff03 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:07.162943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb25cec-1709-430f-92a2-f774d173ff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:07.181850 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-7eb25cec-1709-430f-92a2-f774d173ff03 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:01:07.183136 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-7eb25cec-1709-430f-92a2-f774d173ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:01:07.256878 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 432/855] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:01:07 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 00:01:07.285457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2fc67-d4c1-458d-9482-8f6510e0c3af None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:07.321309 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:07.400934 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2fc67-d4c1-458d-9482-8f6510e0c3af None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:07.441278 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d4c69-bfc1-4c29-9f69-a8b71ddf70ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:07.441856 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d4c69-bfc1-4c29-9f69-a8b71ddf70ad None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:07.442121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d4c69-bfc1-4c29-9f69-a8b71ddf70ad None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:07.442393 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d4c69-bfc1-4c29-9f69-a8b71ddf70ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:07.452985 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d4c69-bfc1-4c29-9f69-a8b71ddf70ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-105d4c69-bfc1-4c29-9f69-a8b71ddf70ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 00:01:07.457838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:07.458865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:07.464829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 424/856] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Jul 26 00:01:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:07.466691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb25cec-1709-430f-92a2-f774d173ff03 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:07.516706 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:07.582869 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb25cec-1709-430f-92a2-f774d173ff03 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:07.622609 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe1a90-9935-4a7a-b38a-ff4d83d0c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:07.623307 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe1a90-9935-4a7a-b38a-ff4d83d0c436 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:07.623593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe1a90-9935-4a7a-b38a-ff4d83d0c436 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:07.623891 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe1a90-9935-4a7a-b38a-ff4d83d0c436 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:07.624608 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe1a90-9935-4a7a-b38a-ff4d83d0c436 None admin] RBAC: Adding query filter params (name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:07.624912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe1a90-9935-4a7a-b38a-ff4d83d0c436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:07.626290 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe1a90-9935-4a7a-b38a-ff4d83d0c436 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:07.636325 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 433/857] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Jul 26 00:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:07.642061 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d4c69-bfc1-4c29-9f69-a8b71ddf70ad None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:07.748022 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:07.766472 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d4c69-bfc1-4c29-9f69-a8b71ddf70ad None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:07.805879 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bce51-03e3-457b-94fd-d1906f0a7c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:07.806946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bce51-03e3-457b-94fd-d1906f0a7c10 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:07.807290 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bce51-03e3-457b-94fd-d1906f0a7c10 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:07.807575 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bce51-03e3-457b-94fd-d1906f0a7c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:07.819967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bce51-03e3-457b-94fd-d1906f0a7c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:07.821459 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bce51-03e3-457b-94fd-d1906f0a7c10 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-aa6bce51-03e3-457b-94fd-d1906f0a7c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:01:07.838091 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:07.840975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:07.842067 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:01:07.842067 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:01:07.842067 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:07.842067 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:07.842067 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 425/858] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:07.846253 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe1a90-9935-4a7a-b38a-ff4d83d0c436 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:07.959923 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe1a90-9935-4a7a-b38a-ff4d83d0c436 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:07.962202 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:08.000832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51305fef-bdef-4d63-a9a6-cf824ad31ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:08.001529 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51305fef-bdef-4d63-a9a6-cf824ad31ece None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:08.001838 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51305fef-bdef-4d63-a9a6-cf824ad31ece None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:08.002086 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51305fef-bdef-4d63-a9a6-cf824ad31ece None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:08.002967 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51305fef-bdef-4d63-a9a6-cf824ad31ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:08.003284 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51305fef-bdef-4d63-a9a6-cf824ad31ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:08.004815 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51305fef-bdef-4d63-a9a6-cf824ad31ece None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:08.018102 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 434/859] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:08.023818 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bce51-03e3-457b-94fd-d1906f0a7c10 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:08.136204 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bce51-03e3-457b-94fd-d1906f0a7c10 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:08.169784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c621a04-f2b1-479b-9769-32a690571f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:08.170454 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c621a04-f2b1-479b-9769-32a690571f51 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:08.170698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c621a04-f2b1-479b-9769-32a690571f51 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:08.171010 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c621a04-f2b1-479b-9769-32a690571f51 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:08.173740 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:08.180087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c621a04-f2b1-479b-9769-32a690571f51 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:08.182005 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c621a04-f2b1-479b-9769-32a690571f51 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-8c621a04-f2b1-479b-9769-32a690571f51 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 00:01:08.194018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:08.195238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:08.196325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:08.196325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:08.196325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 00:01:08.196325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 00:01:08.196325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 00:01:08.196325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 00:01:08.196325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 00:01:08.196325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 00:01:08.196325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 00:01:08.196325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:08.201204 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 426/860] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:08.202304 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51305fef-bdef-4d63-a9a6-cf824ad31ece None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:08.320500 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51305fef-bdef-4d63-a9a6-cf824ad31ece None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:08.358882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a414b1-e2e3-4a7f-802c-8e301befa2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:08.359523 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a414b1-e2e3-4a7f-802c-8e301befa2aa None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:08.359925 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a414b1-e2e3-4a7f-802c-8e301befa2aa None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:08.360203 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a414b1-e2e3-4a7f-802c-8e301befa2aa None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:08.361115 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a414b1-e2e3-4a7f-802c-8e301befa2aa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:08.361430 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a414b1-e2e3-4a7f-802c-8e301befa2aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:08.363178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a414b1-e2e3-4a7f-802c-8e301befa2aa None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:08.382878 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 435/861] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Jul 26 00:01:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:08.388859 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c621a04-f2b1-479b-9769-32a690571f51 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:08.503338 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c621a04-f2b1-479b-9769-32a690571f51 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:08.537440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a6904-146b-42e1-86c7-40cc36b78794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:08.538044 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a6904-146b-42e1-86c7-40cc36b78794 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:08.538326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a6904-146b-42e1-86c7-40cc36b78794 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:08.538607 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a6904-146b-42e1-86c7-40cc36b78794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:08.611991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:08.620416 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a6904-146b-42e1-86c7-40cc36b78794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:08.621978 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a6904-146b-42e1-86c7-40cc36b78794 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:08.748677 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 427/862] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Jul 26 00:01:08 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 00:01:08.750170 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a414b1-e2e3-4a7f-802c-8e301befa2aa None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:08.776001 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:08.858955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a414b1-e2e3-4a7f-802c-8e301befa2aa None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:08.896350 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034f528-9ee8-4be5-a1f7-43c442ee75f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:08.896990 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034f528-9ee8-4be5-a1f7-43c442ee75f2 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:08.897269 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034f528-9ee8-4be5-a1f7-43c442ee75f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:08.897541 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034f528-9ee8-4be5-a1f7-43c442ee75f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:08.908657 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034f528-9ee8-4be5-a1f7-43c442ee75f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:08.910326 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034f528-9ee8-4be5-a1f7-43c442ee75f2 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-8034f528-9ee8-4be5-a1f7-43c442ee75f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:01:08.927828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:08.929050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:08.930159 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:01:08.930159 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:01:08.930159 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:08.930159 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:08.934945 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 436/863] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:08.936408 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a6904-146b-42e1-86c7-40cc36b78794 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:09.043478 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:09.049958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a6904-146b-42e1-86c7-40cc36b78794 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:09.086748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217a689-dc08-4a37-a969-6aa266d95548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:09.087427 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a689-dc08-4a37-a969-6aa266d95548 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:09.087750 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a689-dc08-4a37-a969-6aa266d95548 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:09.088002 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a689-dc08-4a37-a969-6aa266d95548 None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:09.089267 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217a689-dc08-4a37-a969-6aa266d95548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:09.089630 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217a689-dc08-4a37-a969-6aa266d95548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:09.091095 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217a689-dc08-4a37-a969-6aa266d95548 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:09.104842 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 428/864] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:09.111020 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034f528-9ee8-4be5-a1f7-43c442ee75f2 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:09.197771 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:09.228264 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034f528-9ee8-4be5-a1f7-43c442ee75f2 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:09.267982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83354601-338a-4750-b01d-65681c9317f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:09.268698 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83354601-338a-4750-b01d-65681c9317f4 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:09.269112 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83354601-338a-4750-b01d-65681c9317f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:09.269514 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83354601-338a-4750-b01d-65681c9317f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:09.279091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83354601-338a-4750-b01d-65681c9317f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:09.280842 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83354601-338a-4750-b01d-65681c9317f4 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-83354601-338a-4750-b01d-65681c9317f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 00:01:09.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:09.300515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:09.301688 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 00:01:09.301688 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 00:01:09.301688 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 00:01:09.301688 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 00:01:09.301688 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 00:01:09.301688 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 00:01:09.301688 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 00:01:09.301688 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:09.301688 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 437/865] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Jul 26 00:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:09.302290 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217a689-dc08-4a37-a969-6aa266d95548 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:09.421249 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217a689-dc08-4a37-a969-6aa266d95548 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:09.461241 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65edcc9-0564-44b9-824a-6616ca4b3e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:09.462016 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65edcc9-0564-44b9-824a-6616ca4b3e5b None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:09.462321 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65edcc9-0564-44b9-824a-6616ca4b3e5b None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:09.462846 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65edcc9-0564-44b9-824a-6616ca4b3e5b None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:09.463848 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65edcc9-0564-44b9-824a-6616ca4b3e5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:09.464387 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65edcc9-0564-44b9-824a-6616ca4b3e5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:09.466413 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65edcc9-0564-44b9-824a-6616ca4b3e5b None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:09.482528 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 429/866] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Jul 26 00:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:09.489240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83354601-338a-4750-b01d-65681c9317f4 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:09.603315 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83354601-338a-4750-b01d-65681c9317f4 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:09.642026 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9968ae-06fb-4d68-853e-3eeedf6bed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:09.642638 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9968ae-06fb-4d68-853e-3eeedf6bed03 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:09.642947 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9968ae-06fb-4d68-853e-3eeedf6bed03 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:09.643220 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9968ae-06fb-4d68-853e-3eeedf6bed03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:09.643988 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9968ae-06fb-4d68-853e-3eeedf6bed03 None admin] RBAC: Adding query filter params (role.id=6be878a30a464fc38706d4cab9d64f17, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=d88b351fcdad4f2ab1a42e2ac3ee0856) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:09.644300 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9968ae-06fb-4d68-853e-3eeedf6bed03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:09.645939 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9968ae-06fb-4d68-853e-3eeedf6bed03 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:09.648041 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:09.653759 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 438/867] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Jul 26 00:01:09 2022] GET /identity/v3/role_assignments?user.id=d88b351fcdad4f2ab1a42e2ac3ee0856&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=6be878a30a464fc38706d4cab9d64f17 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 00:01:12.255284 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65655b37-1003-4814-8666-cf814757b5a4 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:12.255781 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65655b37-1003-4814-8666-cf814757b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:12.255781 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65655b37-1003-4814-8666-cf814757b5a4 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:12.257112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 430/868] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:01:12.263269 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e97cc6-a758-47c6-bf32-83a475a3b410 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:12.263722 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e97cc6-a758-47c6-bf32-83a475a3b410 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:12.263856 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e97cc6-a758-47c6-bf32-83a475a3b410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:12.282980 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-e7e97cc6-a758-47c6-bf32-83a475a3b410 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:01:12.284179 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-e7e97cc6-a758-47c6-bf32-83a475a3b410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:01:12.355456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 439/869] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:01:12 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 00:01:12.384065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65655b37-1003-4814-8666-cf814757b5a4 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:12.408784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:12.506804 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65655b37-1003-4814-8666-cf814757b5a4 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:12.549065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2d65a-9f97-4b78-815a-4116f8fbe719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:12.549709 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2d65a-9f97-4b78-815a-4116f8fbe719 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:12.549994 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2d65a-9f97-4b78-815a-4116f8fbe719 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:12.550274 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2d65a-9f97-4b78-815a-4116f8fbe719 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:12.562477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2d65a-9f97-4b78-815a-4116f8fbe719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-01e2d65a-9f97-4b78-815a-4116f8fbe719 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 00:01:12.567679 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:12.568748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:12.570054 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 431/870] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Jul 26 00:01:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:12.575186 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e97cc6-a758-47c6-bf32-83a475a3b410 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:12.680253 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e97cc6-a758-47c6-bf32-83a475a3b410 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:12.710607 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:12.720007 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177f9da-a1ec-44f7-b51f-9a4ecc490a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:12.720753 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177f9da-a1ec-44f7-b51f-9a4ecc490a7c None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:12.721069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177f9da-a1ec-44f7-b51f-9a4ecc490a7c None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:12.721404 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177f9da-a1ec-44f7-b51f-9a4ecc490a7c None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:12.722052 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177f9da-a1ec-44f7-b51f-9a4ecc490a7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:12.722466 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177f9da-a1ec-44f7-b51f-9a4ecc490a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:12.723760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177f9da-a1ec-44f7-b51f-9a4ecc490a7c None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:12.734489 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 440/871] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Jul 26 00:01:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:12.740381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2d65a-9f97-4b78-815a-4116f8fbe719 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:12.832865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:12.860094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2d65a-9f97-4b78-815a-4116f8fbe719 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:12.899620 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c1f18-c36d-4fd5-9f77-de2d1fdba7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:12.900268 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c1f18-c36d-4fd5-9f77-de2d1fdba7b8 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:12.900549 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c1f18-c36d-4fd5-9f77-de2d1fdba7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:12.900822 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c1f18-c36d-4fd5-9f77-de2d1fdba7b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:12.914038 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c1f18-c36d-4fd5-9f77-de2d1fdba7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:12.916470 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c1f18-c36d-4fd5-9f77-de2d1fdba7b8 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-d60c1f18-c36d-4fd5-9f77-de2d1fdba7b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:01:12.933753 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:12.934958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:12.936065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:01:12.936065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:01:12.936065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:12.936065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:12.936065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 432/872] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:12.940920 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177f9da-a1ec-44f7-b51f-9a4ecc490a7c None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:13.060055 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177f9da-a1ec-44f7-b51f-9a4ecc490a7c None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:13.098007 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b0234-276f-4017-8c6a-f045a7e6d6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:13.098801 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b0234-276f-4017-8c6a-f045a7e6d6d6 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:13.099083 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b0234-276f-4017-8c6a-f045a7e6d6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:13.099358 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b0234-276f-4017-8c6a-f045a7e6d6d6 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:13.100035 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b0234-276f-4017-8c6a-f045a7e6d6d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:13.100338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b0234-276f-4017-8c6a-f045a7e6d6d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:13.101691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b0234-276f-4017-8c6a-f045a7e6d6d6 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:13.117320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 441/873] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:13.123452 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c1f18-c36d-4fd5-9f77-de2d1fdba7b8 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:13.236450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c1f18-c36d-4fd5-9f77-de2d1fdba7b8 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:13.265847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:13.273982 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef91e63-bb2a-460d-971e-c68d81a4e894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:13.274630 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef91e63-bb2a-460d-971e-c68d81a4e894 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:13.274944 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef91e63-bb2a-460d-971e-c68d81a4e894 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:13.275221 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef91e63-bb2a-460d-971e-c68d81a4e894 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:13.284531 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef91e63-bb2a-460d-971e-c68d81a4e894 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:13.286009 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef91e63-bb2a-460d-971e-c68d81a4e894 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-5ef91e63-bb2a-460d-971e-c68d81a4e894 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 00:01:13.299784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:13.300977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:13.301931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:13.301931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:13.301931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 00:01:13.301931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 00:01:13.301931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 00:01:13.301931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 00:01:13.301931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 00:01:13.301931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 00:01:13.301931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 00:01:13.301931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:13.301931 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 433/874] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:13.308206 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b0234-276f-4017-8c6a-f045a7e6d6d6 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:13.362064 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:13.413519 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b0234-276f-4017-8c6a-f045a7e6d6d6 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:13.449458 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0222a6-c35f-44e1-a490-5bbe4b47b9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:13.450088 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0222a6-c35f-44e1-a490-5bbe4b47b9c1 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:13.450362 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0222a6-c35f-44e1-a490-5bbe4b47b9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:13.450630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0222a6-c35f-44e1-a490-5bbe4b47b9c1 None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:13.451451 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0222a6-c35f-44e1-a490-5bbe4b47b9c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:13.451756 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0222a6-c35f-44e1-a490-5bbe4b47b9c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:13.453202 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0222a6-c35f-44e1-a490-5bbe4b47b9c1 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:13.477460 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 442/875] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Jul 26 00:01:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:13.478694 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef91e63-bb2a-460d-971e-c68d81a4e894 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:13.586303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef91e63-bb2a-460d-971e-c68d81a4e894 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:13.620813 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3a736-40e2-4d22-b547-0de030910fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:13.621353 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3a736-40e2-4d22-b547-0de030910fc3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:13.621627 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3a736-40e2-4d22-b547-0de030910fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:13.621897 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3a736-40e2-4d22-b547-0de030910fc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:13.683806 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:13.700567 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3a736-40e2-4d22-b547-0de030910fc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:13.703216 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3a736-40e2-4d22-b547-0de030910fc3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:13.815639 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 434/876] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Jul 26 00:01:13 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 00:01:13.821678 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0222a6-c35f-44e1-a490-5bbe4b47b9c1 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:13.921829 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0222a6-c35f-44e1-a490-5bbe4b47b9c1 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:13.930633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:13.955425 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152afae3-03cf-47d5-a1df-7c6b87932dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:13.956044 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152afae3-03cf-47d5-a1df-7c6b87932dd0 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:13.956319 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152afae3-03cf-47d5-a1df-7c6b87932dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:13.956588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152afae3-03cf-47d5-a1df-7c6b87932dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:13.967171 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152afae3-03cf-47d5-a1df-7c6b87932dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:13.968580 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152afae3-03cf-47d5-a1df-7c6b87932dd0 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-152afae3-03cf-47d5-a1df-7c6b87932dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:01:13.982776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:13.983727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:13.985088 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:01:13.985088 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:01:13.985088 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:13.985088 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:13.985088 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 443/877] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:13.990209 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3a736-40e2-4d22-b547-0de030910fc3 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:14.075514 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:14.087774 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3a736-40e2-4d22-b547-0de030910fc3 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:14.120407 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77c1d2-19dd-4375-baea-99ee30cbc4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:14.121019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77c1d2-19dd-4375-baea-99ee30cbc4aa None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:14.121303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77c1d2-19dd-4375-baea-99ee30cbc4aa None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:14.121581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77c1d2-19dd-4375-baea-99ee30cbc4aa None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:14.122260 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77c1d2-19dd-4375-baea-99ee30cbc4aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:14.122568 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77c1d2-19dd-4375-baea-99ee30cbc4aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:14.123985 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77c1d2-19dd-4375-baea-99ee30cbc4aa None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:14.134865 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 435/878] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:14.141076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152afae3-03cf-47d5-a1df-7c6b87932dd0 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:14.237369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152afae3-03cf-47d5-a1df-7c6b87932dd0 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:14.269244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5070c-26cf-4da7-a34d-64fb4dd3c075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:14.269854 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5070c-26cf-4da7-a34d-64fb4dd3c075 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:14.270134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5070c-26cf-4da7-a34d-64fb4dd3c075 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:14.270403 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5070c-26cf-4da7-a34d-64fb4dd3c075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:14.277959 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5070c-26cf-4da7-a34d-64fb4dd3c075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:14.279405 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5070c-26cf-4da7-a34d-64fb4dd3c075 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-bed5070c-26cf-4da7-a34d-64fb4dd3c075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 00:01:14.290250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:14.291295 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:14.292664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 00:01:14.292664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 00:01:14.292664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 00:01:14.292664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 00:01:14.292664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 00:01:14.292664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 00:01:14.292664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 00:01:14.292664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:14.292664 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 444/879] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Jul 26 00:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:14.297188 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77c1d2-19dd-4375-baea-99ee30cbc4aa None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:14.395596 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77c1d2-19dd-4375-baea-99ee30cbc4aa None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:14.427424 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551a152-f0f9-4aab-8bad-484dd4748226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:14.428022 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551a152-f0f9-4aab-8bad-484dd4748226 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:14.428300 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551a152-f0f9-4aab-8bad-484dd4748226 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:14.428569 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551a152-f0f9-4aab-8bad-484dd4748226 None admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:14.429289 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551a152-f0f9-4aab-8bad-484dd4748226 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:14.429591 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551a152-f0f9-4aab-8bad-484dd4748226 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:14.431025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551a152-f0f9-4aab-8bad-484dd4748226 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:14.443345 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 436/880] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Jul 26 00:01:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:14.449966 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5070c-26cf-4da7-a34d-64fb4dd3c075 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:14.471400 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:14.545781 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5070c-26cf-4da7-a34d-64fb4dd3c075 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:14.578442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1235b5a-264c-4cf9-acfe-a7e0dadc8c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:14.579061 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1235b5a-264c-4cf9-acfe-a7e0dadc8c13 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:14.579336 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1235b5a-264c-4cf9-acfe-a7e0dadc8c13 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:14.579605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1235b5a-264c-4cf9-acfe-a7e0dadc8c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:14.580361 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1235b5a-264c-4cf9-acfe-a7e0dadc8c13 None admin] RBAC: Adding query filter params (role.id=5d947b934e0642c5a4ab00d547ec3fda, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=d88b351fcdad4f2ab1a42e2ac3ee0856) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:14.580666 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1235b5a-264c-4cf9-acfe-a7e0dadc8c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:14.582076 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1235b5a-264c-4cf9-acfe-a7e0dadc8c13 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:14.587245 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 445/881] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Jul 26 00:01:14 2022] GET /identity/v3/role_assignments?user.id=d88b351fcdad4f2ab1a42e2ac3ee0856&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=5d947b934e0642c5a4ab00d547ec3fda => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:16.797320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a04b9-d6ae-479e-bf81-617fda7266b9 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:16.797880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a04b9-d6ae-479e-bf81-617fda7266b9 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:16.797880 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a04b9-d6ae-479e-bf81-617fda7266b9 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:16.799266 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 437/882] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:01:16.804416 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109047f-2f8b-4de2-8cab-b9bfb95c2003 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:16.804829 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109047f-2f8b-4de2-8cab-b9bfb95c2003 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:16.804977 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109047f-2f8b-4de2-8cab-b9bfb95c2003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:16.824065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-a109047f-2f8b-4de2-8cab-b9bfb95c2003 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:01:16.825234 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-a109047f-2f8b-4de2-8cab-b9bfb95c2003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:01:16.890803 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 446/883] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:01:16 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 00:01:16.920140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a04b9-d6ae-479e-bf81-617fda7266b9 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:16.930800 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:17.023317 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a04b9-d6ae-479e-bf81-617fda7266b9 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:17.057728 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28452-9cc2-4c56-bcc2-1d76edd33746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:17.058514 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28452-9cc2-4c56-bcc2-1d76edd33746 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:17.058832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28452-9cc2-4c56-bcc2-1d76edd33746 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:17.059112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28452-9cc2-4c56-bcc2-1d76edd33746 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:17.068855 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e28452-9cc2-4c56-bcc2-1d76edd33746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-d6e28452-9cc2-4c56-bcc2-1d76edd33746 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 00:01:17.073959 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:17.075111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:17.076147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 438/884] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Jul 26 00:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:17.081169 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109047f-2f8b-4de2-8cab-b9bfb95c2003 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:17.096017 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:17.178559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109047f-2f8b-4de2-8cab-b9bfb95c2003 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:17.211912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025f62f-1484-45ef-b595-0e69ae0747c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:17.212515 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025f62f-1484-45ef-b595-0e69ae0747c8 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:17.212797 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025f62f-1484-45ef-b595-0e69ae0747c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:17.213073 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025f62f-1484-45ef-b595-0e69ae0747c8 None admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:17.213960 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025f62f-1484-45ef-b595-0e69ae0747c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:17.214265 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025f62f-1484-45ef-b595-0e69ae0747c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:17.215663 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025f62f-1484-45ef-b595-0e69ae0747c8 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:17.223530 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 447/885] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Jul 26 00:01:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:17.230205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28452-9cc2-4c56-bcc2-1d76edd33746 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:17.295147 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:17.327267 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28452-9cc2-4c56-bcc2-1d76edd33746 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:17.360420 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bb9f8-9ca6-4400-94af-fad90cb01a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:17.361038 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bb9f8-9ca6-4400-94af-fad90cb01a2d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:17.361316 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bb9f8-9ca6-4400-94af-fad90cb01a2d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:17.361586 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bb9f8-9ca6-4400-94af-fad90cb01a2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:17.371302 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bb9f8-9ca6-4400-94af-fad90cb01a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:17.372733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bb9f8-9ca6-4400-94af-fad90cb01a2d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-4e6bb9f8-9ca6-4400-94af-fad90cb01a2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:01:17.386906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:17.387937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:17.388964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:01:17.388964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:01:17.388964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:17.388964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:17.388964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 439/886] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:17.393778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025f62f-1484-45ef-b595-0e69ae0747c8 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:17.469160 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:17.492580 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025f62f-1484-45ef-b595-0e69ae0747c8 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:17.524281 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dccce2-f56f-448d-82cb-2f99363115e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:17.524875 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dccce2-f56f-448d-82cb-2f99363115e7 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:17.525152 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dccce2-f56f-448d-82cb-2f99363115e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:17.525422 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dccce2-f56f-448d-82cb-2f99363115e7 None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:17.526610 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dccce2-f56f-448d-82cb-2f99363115e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:17.527013 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dccce2-f56f-448d-82cb-2f99363115e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:17.528361 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dccce2-f56f-448d-82cb-2f99363115e7 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:17.539474 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 448/887] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:17.546084 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bb9f8-9ca6-4400-94af-fad90cb01a2d None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:17.642481 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bb9f8-9ca6-4400-94af-fad90cb01a2d None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:17.661325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:17.677797 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0083cb0-d11e-44c2-9e1f-2eed99cbc431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:17.678532 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0083cb0-d11e-44c2-9e1f-2eed99cbc431 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:17.679001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0083cb0-d11e-44c2-9e1f-2eed99cbc431 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:17.679369 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0083cb0-d11e-44c2-9e1f-2eed99cbc431 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:17.689822 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0083cb0-d11e-44c2-9e1f-2eed99cbc431 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:17.692048 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0083cb0-d11e-44c2-9e1f-2eed99cbc431 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-a0083cb0-d11e-44c2-9e1f-2eed99cbc431 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 00:01:17.707832 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:17.708946 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:17.709878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:17.709878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:17.709878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 00:01:17.709878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 00:01:17.709878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 00:01:17.709878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 00:01:17.709878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 00:01:17.709878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 00:01:17.709878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 00:01:17.709878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:17.709878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 440/888] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:17.716381 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dccce2-f56f-448d-82cb-2f99363115e7 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:17.819815 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dccce2-f56f-448d-82cb-2f99363115e7 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:17.853549 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448a351-5a42-4de5-913e-c4c1de00e461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:17.854319 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448a351-5a42-4de5-913e-c4c1de00e461 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:17.854803 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448a351-5a42-4de5-913e-c4c1de00e461 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:17.855088 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448a351-5a42-4de5-913e-c4c1de00e461 None admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:17.855866 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448a351-5a42-4de5-913e-c4c1de00e461 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:17.856175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448a351-5a42-4de5-913e-c4c1de00e461 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:17.857598 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448a351-5a42-4de5-913e-c4c1de00e461 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:17.860093 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:17.874631 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 449/889] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Jul 26 00:01:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 00:01:17.880312 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0083cb0-d11e-44c2-9e1f-2eed99cbc431 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:17.977676 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0083cb0-d11e-44c2-9e1f-2eed99cbc431 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:18.012243 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ab0e8-cfbc-4f67-bc61-6f166209e303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:18.012875 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ab0e8-cfbc-4f67-bc61-6f166209e303 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:18.013161 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ab0e8-cfbc-4f67-bc61-6f166209e303 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:18.013439 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ab0e8-cfbc-4f67-bc61-6f166209e303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:18.023640 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ab0e8-cfbc-4f67-bc61-6f166209e303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:18.025082 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ab0e8-cfbc-4f67-bc61-6f166209e303 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-bb5ab0e8-cfbc-4f67-bc61-6f166209e303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:01:18.039696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:18.040711 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:18.042205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:01:18.042205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:01:18.042205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:18.042205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:18.042205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 441/890] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:18.047317 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448a351-5a42-4de5-913e-c4c1de00e461 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:18.142221 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448a351-5a42-4de5-913e-c4c1de00e461 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:18.175189 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710a630-f484-48ef-925f-f6c5fb3df33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:18.175787 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a630-f484-48ef-925f-f6c5fb3df33a None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:18.176062 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a630-f484-48ef-925f-f6c5fb3df33a None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:18.176331 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a630-f484-48ef-925f-f6c5fb3df33a None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:18.176993 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710a630-f484-48ef-925f-f6c5fb3df33a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:18.177291 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710a630-f484-48ef-925f-f6c5fb3df33a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:18.178647 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710a630-f484-48ef-925f-f6c5fb3df33a None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:18.190257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 450/891] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:18.195906 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ab0e8-cfbc-4f67-bc61-6f166209e303 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:18.226831 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:18.294476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ab0e8-cfbc-4f67-bc61-6f166209e303 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:18.327596 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8d436-69f1-4c0c-9712-06ef7409eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:18.328219 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8d436-69f1-4c0c-9712-06ef7409eee3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:18.328502 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8d436-69f1-4c0c-9712-06ef7409eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:18.328779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8d436-69f1-4c0c-9712-06ef7409eee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:18.335283 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8d436-69f1-4c0c-9712-06ef7409eee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:18.336733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8d436-69f1-4c0c-9712-06ef7409eee3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-97e8d436-69f1-4c0c-9712-06ef7409eee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 00:01:18.347937 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:18.348973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:18.350079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 00:01:18.350079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 00:01:18.350079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 00:01:18.350079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 00:01:18.350079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 00:01:18.350079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 00:01:18.350079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 00:01:18.350079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:18.350079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 442/892] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Jul 26 00:01:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:18.355120 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710a630-f484-48ef-925f-f6c5fb3df33a None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:18.410660 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:18.456594 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710a630-f484-48ef-925f-f6c5fb3df33a None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:18.489593 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90580de-368b-4dc3-99d6-cb5e2695db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:18.490197 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90580de-368b-4dc3-99d6-cb5e2695db1e None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:18.490473 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90580de-368b-4dc3-99d6-cb5e2695db1e None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:18.490799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90580de-368b-4dc3-99d6-cb5e2695db1e None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:18.491532 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90580de-368b-4dc3-99d6-cb5e2695db1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:18.491840 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90580de-368b-4dc3-99d6-cb5e2695db1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:18.493250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90580de-368b-4dc3-99d6-cb5e2695db1e None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:18.504848 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 451/893] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Jul 26 00:01:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:18.511640 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8d436-69f1-4c0c-9712-06ef7409eee3 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:18.600540 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:18.609621 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8d436-69f1-4c0c-9712-06ef7409eee3 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:18.642175 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf452-7493-4c6b-9d9b-7badc10d3b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:18.642847 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf452-7493-4c6b-9d9b-7badc10d3b48 None admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:18.643131 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf452-7493-4c6b-9d9b-7badc10d3b48 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:18.643410 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf452-7493-4c6b-9d9b-7badc10d3b48 None admin] PATH_INFO: `/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/d88b351fcdad4f2ab1a42e2ac3ee0856/roles/5d947b934e0642c5a4ab00d547ec3fda` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:18.645299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaf452-7493-4c6b-9d9b-7badc10d3b48 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d685fe7e12e4d86a5d5db9253e7e11f, user_id=d88b351fcdad4f2ab1a42e2ac3ee0856, role_id=5d947b934e0642c5a4ab00d547ec3fda)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:18.646746 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaf452-7493-4c6b-9d9b-7badc10d3b48 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:18.659130 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 443/894] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Jul 26 00:01:18 2022] PUT /identity/v3/projects/4d685fe7e12e4d86a5d5db9253e7e11f/users/d88b351fcdad4f2ab1a42e2ac3ee0856/roles/5d947b934e0642c5a4ab00d547ec3fda => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:01:20.850010 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d04e8f-c627-4a4c-800a-389593c48ede None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:20.850545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d04e8f-c627-4a4c-800a-389593c48ede None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:20.850545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d04e8f-c627-4a4c-800a-389593c48ede None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:20.851948 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 452/895] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:01:20.857793 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02b45d-71a3-41d2-bac1-d8d735aae38e None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:20.858265 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02b45d-71a3-41d2-bac1-d8d735aae38e None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:20.858360 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02b45d-71a3-41d2-bac1-d8d735aae38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:20.876681 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-1a02b45d-71a3-41d2-bac1-d8d735aae38e None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:01:20.877857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-1a02b45d-71a3-41d2-bac1-d8d735aae38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:01:20.948030 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 444/896] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:01:20 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 00:01:20.972306 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d04e8f-c627-4a4c-800a-389593c48ede None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:21.078331 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d04e8f-c627-4a4c-800a-389593c48ede None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:21.091886 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:21.111869 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f88f0-b035-4d24-a58d-a1a9073edc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:21.112442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f88f0-b035-4d24-a58d-a1a9073edc02 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:21.112724 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f88f0-b035-4d24-a58d-a1a9073edc02 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:21.113025 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f88f0-b035-4d24-a58d-a1a9073edc02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:21.123377 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f88f0-b035-4d24-a58d-a1a9073edc02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-cf7f88f0-b035-4d24-a58d-a1a9073edc02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 00:01:21.128247 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:21.129383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:21.130633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 453/897] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Jul 26 00:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:21.136017 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02b45d-71a3-41d2-bac1-d8d735aae38e None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:21.215220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:21.233780 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02b45d-71a3-41d2-bac1-d8d735aae38e None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:21.267053 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a49a7-405a-4565-8b7b-d6955940d295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:21.267664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a49a7-405a-4565-8b7b-d6955940d295 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:21.267941 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a49a7-405a-4565-8b7b-d6955940d295 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:21.268212 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a49a7-405a-4565-8b7b-d6955940d295 None admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:21.268911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a49a7-405a-4565-8b7b-d6955940d295 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:21.269212 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a49a7-405a-4565-8b7b-d6955940d295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:21.270606 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a49a7-405a-4565-8b7b-d6955940d295 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:21.279314 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 445/898] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Jul 26 00:01:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:21.284963 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f88f0-b035-4d24-a58d-a1a9073edc02 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:21.381891 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f88f0-b035-4d24-a58d-a1a9073edc02 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:21.415213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bffe5-f7d7-4554-9085-62cf55aa3944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:21.415829 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bffe5-f7d7-4554-9085-62cf55aa3944 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:21.416107 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bffe5-f7d7-4554-9085-62cf55aa3944 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:21.416408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bffe5-f7d7-4554-9085-62cf55aa3944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:21.426421 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bffe5-f7d7-4554-9085-62cf55aa3944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:21.427885 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bffe5-f7d7-4554-9085-62cf55aa3944 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-798bffe5-f7d7-4554-9085-62cf55aa3944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:01:21.442442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:21.443497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:21.444772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:01:21.444772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:01:21.444772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:21.444772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:21.444772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 454/899] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:21.449825 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a49a7-405a-4565-8b7b-d6955940d295 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:21.544898 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a49a7-405a-4565-8b7b-d6955940d295 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:21.577005 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1511c-fd07-456d-9d47-21a9aa06073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:21.577603 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1511c-fd07-456d-9d47-21a9aa06073e None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:21.577881 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1511c-fd07-456d-9d47-21a9aa06073e None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:21.578154 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1511c-fd07-456d-9d47-21a9aa06073e None admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:21.578860 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1511c-fd07-456d-9d47-21a9aa06073e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:21.579161 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1511c-fd07-456d-9d47-21a9aa06073e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:21.580533 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1511c-fd07-456d-9d47-21a9aa06073e None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:21.592087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 446/900] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:21.597607 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bffe5-f7d7-4554-9085-62cf55aa3944 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:21.625551 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:21.698078 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bffe5-f7d7-4554-9085-62cf55aa3944 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:21.733891 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d93dc-b7fc-4623-96ec-2a1b3a42f6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:21.734522 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d93dc-b7fc-4623-96ec-2a1b3a42f6ff None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:21.734836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d93dc-b7fc-4623-96ec-2a1b3a42f6ff None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:21.735112 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d93dc-b7fc-4623-96ec-2a1b3a42f6ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:21.742606 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d93dc-b7fc-4623-96ec-2a1b3a42f6ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:21.744081 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d93dc-b7fc-4623-96ec-2a1b3a42f6ff None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-521d93dc-b7fc-4623-96ec-2a1b3a42f6ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 00:01:21.755814 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:21.756930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:21.757940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:21.757940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:21.757940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 00:01:21.757940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 00:01:21.757940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 00:01:21.757940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 00:01:21.757940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 00:01:21.757940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 00:01:21.757940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 00:01:21.757940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:21.757940 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 455/901] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:21.762882 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1511c-fd07-456d-9d47-21a9aa06073e None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:21.766634 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:21.861778 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1511c-fd07-456d-9d47-21a9aa06073e None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:21.893785 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3271e1-6d8c-4f96-93e2-2435c2a1e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:21.894387 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3271e1-6d8c-4f96-93e2-2435c2a1e443 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:21.894664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3271e1-6d8c-4f96-93e2-2435c2a1e443 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:21.894966 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3271e1-6d8c-4f96-93e2-2435c2a1e443 None admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:21.895735 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3271e1-6d8c-4f96-93e2-2435c2a1e443 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:21.896041 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3271e1-6d8c-4f96-93e2-2435c2a1e443 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:21.897458 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3271e1-6d8c-4f96-93e2-2435c2a1e443 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:21.914076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 447/902] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Jul 26 00:01:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:21.920081 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d93dc-b7fc-4623-96ec-2a1b3a42f6ff None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:22.003697 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:22.018877 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d93dc-b7fc-4623-96ec-2a1b3a42f6ff None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:22.051069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2201717-2aa9-47f2-a6b6-654488f92c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:22.051676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2201717-2aa9-47f2-a6b6-654488f92c69 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:22.051955 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2201717-2aa9-47f2-a6b6-654488f92c69 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:22.052227 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2201717-2aa9-47f2-a6b6-654488f92c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:22.116763 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2201717-2aa9-47f2-a6b6-654488f92c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:22.118201 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2201717-2aa9-47f2-a6b6-654488f92c69 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:22.197871 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:22.213283 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 456/903] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Jul 26 00:01:21 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 00:01:22.220526 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3271e1-6d8c-4f96-93e2-2435c2a1e443 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:22.281779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:22.320624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3271e1-6d8c-4f96-93e2-2435c2a1e443 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:22.360093 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f651e1d-163d-495b-ba08-c6f32bef6cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:22.360718 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f651e1d-163d-495b-ba08-c6f32bef6cc8 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:22.361001 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f651e1d-163d-495b-ba08-c6f32bef6cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:22.361273 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f651e1d-163d-495b-ba08-c6f32bef6cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:22.371429 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f651e1d-163d-495b-ba08-c6f32bef6cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:22.372863 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f651e1d-163d-495b-ba08-c6f32bef6cc8 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-2f651e1d-163d-495b-ba08-c6f32bef6cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 00:01:22.386961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:22.388029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:22.388943 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 00:01:22.388943 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 00:01:22.388943 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 00:01:22.388943 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:22.388943 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 448/904] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:22.394036 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2201717-2aa9-47f2-a6b6-654488f92c69 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:22.490393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2201717-2aa9-47f2-a6b6-654488f92c69 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:22.523832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a8630-afd2-4c4e-863a-bfd3760b2ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:22.524436 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a8630-afd2-4c4e-863a-bfd3760b2ada None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:22.524718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a8630-afd2-4c4e-863a-bfd3760b2ada None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:22.524995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a8630-afd2-4c4e-863a-bfd3760b2ada None admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:22.525667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a8630-afd2-4c4e-863a-bfd3760b2ada None admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:22.526616 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a8630-afd2-4c4e-863a-bfd3760b2ada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:22.528014 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a8630-afd2-4c4e-863a-bfd3760b2ada None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:22.538919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 457/905] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Jul 26 00:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:22.545612 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f651e1d-163d-495b-ba08-c6f32bef6cc8 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:22.642636 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f651e1d-163d-495b-ba08-c6f32bef6cc8 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:22.655982 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:22.678408 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01190381-2d73-42e4-a595-488b89854cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:22.679083 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01190381-2d73-42e4-a595-488b89854cf0 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:22.679368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01190381-2d73-42e4-a595-488b89854cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:22.679644 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01190381-2d73-42e4-a595-488b89854cf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:22.686625 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01190381-2d73-42e4-a595-488b89854cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:22.688142 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01190381-2d73-42e4-a595-488b89854cf0 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application [None req-01190381-2d73-42e4-a595-488b89854cf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 00:01:22.699299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:22.700357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:22.701433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 00:01:22.701433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 00:01:22.701433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 00:01:22.701433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 00:01:22.701433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 00:01:22.701433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 00:01:22.701433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 00:01:22.701433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: ERROR keystone.server.flask.application Jul 26 00:01:22.701433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 449/906] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Jul 26 00:01:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:22.706563 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a8630-afd2-4c4e-863a-bfd3760b2ada None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:22.751994 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:22.804234 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a8630-afd2-4c4e-863a-bfd3760b2ada None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:22.836690 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b186da1-04d9-4b3f-902b-f2480b377f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:22.837294 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b186da1-04d9-4b3f-902b-f2480b377f93 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:22.837575 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b186da1-04d9-4b3f-902b-f2480b377f93 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:22.837849 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b186da1-04d9-4b3f-902b-f2480b377f93 None admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:22.839328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b186da1-04d9-4b3f-902b-f2480b377f93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:22.839582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b186da1-04d9-4b3f-902b-f2480b377f93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:22.840999 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b186da1-04d9-4b3f-902b-f2480b377f93 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:22.852514 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 458/907] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Jul 26 00:01:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:22.859316 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01190381-2d73-42e4-a595-488b89854cf0 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:22.958534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01190381-2d73-42e4-a595-488b89854cf0 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:22.991801 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc41589-9c1d-4940-a5de-c936e0d9e84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:22.992410 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41589-9c1d-4940-a5de-c936e0d9e84d None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:22.992690 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41589-9c1d-4940-a5de-c936e0d9e84d None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:22.992963 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41589-9c1d-4940-a5de-c936e0d9e84d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:22.993726 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc41589-9c1d-4940-a5de-c936e0d9e84d None admin] RBAC: Adding query filter params (role.id=5d947b934e0642c5a4ab00d547ec3fda, scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f, user.id=d88b351fcdad4f2ab1a42e2ac3ee0856) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:22.994037 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc41589-9c1d-4940-a5de-c936e0d9e84d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:22.995709 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc41589-9c1d-4940-a5de-c936e0d9e84d None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:23.001358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 450/908] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Jul 26 00:01:22 2022] GET /identity/v3/role_assignments?user.id=d88b351fcdad4f2ab1a42e2ac3ee0856&scope.project.id=4d685fe7e12e4d86a5d5db9253e7e11f&role.id=5d947b934e0642c5a4ab00d547ec3fda => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:25.217875 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b487a3-0bfc-4721-b033-f88a3bfb54f8 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:25.218397 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b487a3-0bfc-4721-b033-f88a3bfb54f8 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:25.218513 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b487a3-0bfc-4721-b033-f88a3bfb54f8 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:25.219790 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 459/909] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:01:25.224981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86a83-ea81-4a89-b6c0-e08c1a9fa6d0 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:25.225417 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86a83-ea81-4a89-b6c0-e08c1a9fa6d0 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:25.225535 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86a83-ea81-4a89-b6c0-e08c1a9fa6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:25.243688 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-5bd86a83-ea81-4a89-b6c0-e08c1a9fa6d0 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:01:25.245466 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-5bd86a83-ea81-4a89-b6c0-e08c1a9fa6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:01:25.273899 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:25.311281 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 451/910] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:01:25 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 00:01:25.333821 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b487a3-0bfc-4721-b033-f88a3bfb54f8 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:25.431584 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b487a3-0bfc-4721-b033-f88a3bfb54f8 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:25.439782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:25.465617 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dbc46-8377-4417-a029-02af5c922df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:25.466250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dbc46-8377-4417-a029-02af5c922df2 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:25.466533 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dbc46-8377-4417-a029-02af5c922df2 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:25.466841 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dbc46-8377-4417-a029-02af5c922df2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:25.467455 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20dbc46-8377-4417-a029-02af5c922df2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:25.468820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20dbc46-8377-4417-a029-02af5c922df2 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-d20dbc46-8377-4417-a029-02af5c922df2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:25.477402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:25.478548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:25.480273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 460/911] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Jul 26 00:01:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:25.484929 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd86a83-ea81-4a89-b6c0-e08c1a9fa6d0 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:25.579726 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd86a83-ea81-4a89-b6c0-e08c1a9fa6d0 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:25.613019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd338d-ae29-4772-89a5-58cfe9444dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:25.613618 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd338d-ae29-4772-89a5-58cfe9444dc3 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:25.613895 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd338d-ae29-4772-89a5-58cfe9444dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:25.614166 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd338d-ae29-4772-89a5-58cfe9444dc3 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:25.614864 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd338d-ae29-4772-89a5-58cfe9444dc3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:25.615160 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd338d-ae29-4772-89a5-58cfe9444dc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:25.616511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd338d-ae29-4772-89a5-58cfe9444dc3 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:25.622053 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 452/912] 10.222.0.65 () {56 vars in 1116 bytes} [Tue Jul 26 00:01:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:25.627533 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dbc46-8377-4417-a029-02af5c922df2 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:25.744836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dbc46-8377-4417-a029-02af5c922df2 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:25.778060 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641f8fe-7925-476f-bd0e-ca93d4c49062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:25.778677 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f8fe-7925-476f-bd0e-ca93d4c49062 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:25.778997 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f8fe-7925-476f-bd0e-ca93d4c49062 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:25.779276 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f8fe-7925-476f-bd0e-ca93d4c49062 None admin] PATH_INFO: `/v3/services` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:25.779938 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641f8fe-7925-476f-bd0e-ca93d4c49062 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:25.780244 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641f8fe-7925-476f-bd0e-ca93d4c49062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:25.781619 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641f8fe-7925-476f-bd0e-ca93d4c49062 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:25.785935 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 461/913] 10.222.0.65 () {56 vars in 1116 bytes} [Tue Jul 26 00:01:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:27.966660 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07d0c1-800e-491b-9de9-e720baeb7966 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:27.967220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07d0c1-800e-491b-9de9-e720baeb7966 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:27.967220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07d0c1-800e-491b-9de9-e720baeb7966 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:27.968627 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 453/914] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:01:27.973661 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bfa96-8690-4531-8900-d7b542c5d936 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:27.974047 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bfa96-8690-4531-8900-d7b542c5d936 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:27.974212 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bfa96-8690-4531-8900-d7b542c5d936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:27.992126 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-6c4bfa96-8690-4531-8900-d7b542c5d936 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:01:27.993293 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-6c4bfa96-8690-4531-8900-d7b542c5d936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:01:28.020183 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:28.059413 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 462/915] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:01:27 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 00:01:28.083270 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07d0c1-800e-491b-9de9-e720baeb7966 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:28.113290 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:28.182908 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07d0c1-800e-491b-9de9-e720baeb7966 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:28.214640 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b83eb-b3fc-4c3e-8702-60ab37be5314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:28.215272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b83eb-b3fc-4c3e-8702-60ab37be5314 None admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:28.215553 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b83eb-b3fc-4c3e-8702-60ab37be5314 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:28.215826 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b83eb-b3fc-4c3e-8702-60ab37be5314 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:28.216510 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b83eb-b3fc-4c3e-8702-60ab37be5314 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:28.217914 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b83eb-b3fc-4c3e-8702-60ab37be5314 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:28.232965 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 454/916] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Jul 26 00:01:28 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 00:01:30.449543 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7735d-7cc4-4fd1-9922-a3b433d62c15 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:30.450070 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7735d-7cc4-4fd1-9922-a3b433d62c15 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:30.450177 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7735d-7cc4-4fd1-9922-a3b433d62c15 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:30.451457 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 463/917] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:01:30.456624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fef4a-4b64-486d-a1e5-a71f4285fcc3 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:30.457013 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fef4a-4b64-486d-a1e5-a71f4285fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:30.457178 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fef4a-4b64-486d-a1e5-a71f4285fcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:30.474728 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-246fef4a-4b64-486d-a1e5-a71f4285fcc3 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:01:30.475922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-246fef4a-4b64-486d-a1e5-a71f4285fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:01:30.545812 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 455/918] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:01:30 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 00:01:30.569393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7735d-7cc4-4fd1-9922-a3b433d62c15 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:30.668944 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7735d-7cc4-4fd1-9922-a3b433d62c15 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:30.705833 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39747187-78db-4fd2-90c2-e99cec147927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:30.706400 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39747187-78db-4fd2-90c2-e99cec147927 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:30.706681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39747187-78db-4fd2-90c2-e99cec147927 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:30.706989 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39747187-78db-4fd2-90c2-e99cec147927 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:30.707605 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39747187-78db-4fd2-90c2-e99cec147927 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:30.708970 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39747187-78db-4fd2-90c2-e99cec147927 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-39747187-78db-4fd2-90c2-e99cec147927 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:30.718526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:30.719718 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:30.720583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 464/919] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Jul 26 00:01:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:30.725661 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fef4a-4b64-486d-a1e5-a71f4285fcc3 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:30.743542 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:30.827137 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fef4a-4b64-486d-a1e5-a71f4285fcc3 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:30.861432 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb52b88-f78a-4254-9567-85f0649638d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:30.862046 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb52b88-f78a-4254-9567-85f0649638d6 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:30.862328 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb52b88-f78a-4254-9567-85f0649638d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:30.862605 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb52b88-f78a-4254-9567-85f0649638d6 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:30.863307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb52b88-f78a-4254-9567-85f0649638d6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:30.863617 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb52b88-f78a-4254-9567-85f0649638d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:30.864988 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb52b88-f78a-4254-9567-85f0649638d6 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:30.870039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 456/920] 10.222.0.65 () {56 vars in 1116 bytes} [Tue Jul 26 00:01:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:30.876050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39747187-78db-4fd2-90c2-e99cec147927 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:30.904253 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:30.974223 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39747187-78db-4fd2-90c2-e99cec147927 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:31.007730 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3730e-8823-47c8-9029-9c0f95f78dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:31.008338 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3730e-8823-47c8-9029-9c0f95f78dd1 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:31.008613 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3730e-8823-47c8-9029-9c0f95f78dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:31.008881 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3730e-8823-47c8-9029-9c0f95f78dd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:31.009648 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3730e-8823-47c8-9029-9c0f95f78dd1 None admin] RBAC: Adding query filter params (interface=public, service_id=fa3d58f3998b4347966142dadd736c20, region_id=RegionOne) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:31.009951 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3730e-8823-47c8-9029-9c0f95f78dd1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:31.011404 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3730e-8823-47c8-9029-9c0f95f78dd1 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:31.016190 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 465/921] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Jul 26 00:01:30 2022] GET /identity/v3/endpoints?service_id=fa3d58f3998b4347966142dadd736c20&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:31.021768 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb52b88-f78a-4254-9567-85f0649638d6 None admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:31.102401 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:31.120904 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb52b88-f78a-4254-9567-85f0649638d6 None admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:31.153460 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f20fa-a4c4-4a72-8409-ffd776b64238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:31.154061 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f20fa-a4c4-4a72-8409-ffd776b64238 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:31.154341 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f20fa-a4c4-4a72-8409-ffd776b64238 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:31.154613 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f20fa-a4c4-4a72-8409-ffd776b64238 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:31.155289 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f20fa-a4c4-4a72-8409-ffd776b64238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:31.156650 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f20fa-a4c4-4a72-8409-ffd776b64238 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:31.163089 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 457/922] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Jul 26 00:01:31 2022] GET /identity/v3/services => generated 1962 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 00:01:33.364421 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f6ab-7c47-471e-bdc7-dcda3ea4d101 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:33.364943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f6ab-7c47-471e-bdc7-dcda3ea4d101 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:33.364943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f6ab-7c47-471e-bdc7-dcda3ea4d101 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:33.366299 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 466/923] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:01:33.372069 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad4a9a-9d11-4d92-84be-d907a3c1ecbc None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:33.372443 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad4a9a-9d11-4d92-84be-d907a3c1ecbc None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:33.372634 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad4a9a-9d11-4d92-84be-d907a3c1ecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:33.390829 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-7cad4a9a-9d11-4d92-84be-d907a3c1ecbc None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:01:33.392003 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-7cad4a9a-9d11-4d92-84be-d907a3c1ecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:01:33.455806 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 458/924] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:01:33 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 00:01:33.479727 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64f6ab-7c47-471e-bdc7-dcda3ea4d101 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:33.569158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:33.578630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64f6ab-7c47-471e-bdc7-dcda3ea4d101 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:33.611097 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00815cad-682e-460e-9904-b1add00b4989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:33.611720 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00815cad-682e-460e-9904-b1add00b4989 None admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:33.611999 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00815cad-682e-460e-9904-b1add00b4989 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:33.612269 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00815cad-682e-460e-9904-b1add00b4989 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:33.612883 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00815cad-682e-460e-9904-b1add00b4989 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:33.614235 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00815cad-682e-460e-9904-b1add00b4989 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application [None req-00815cad-682e-460e-9904-b1add00b4989 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 00:01:33.623676 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 00:01:33.624832 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application with Lock( Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self._enter() Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application return self.creator() Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application created_value = creator( Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: ERROR keystone.server.flask.application Jul 26 00:01:33.625882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 467/925] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Jul 26 00:01:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 00:01:33.630835 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad4a9a-9d11-4d92-84be-d907a3c1ecbc None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:33.704337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:33.726080 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad4a9a-9d11-4d92-84be-d907a3c1ecbc None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:33.759491 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eb4f3-11f9-40c5-817b-7100266a53b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:33.760123 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eb4f3-11f9-40c5-817b-7100266a53b8 None admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:33.760404 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eb4f3-11f9-40c5-817b-7100266a53b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:33.760822 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eb4f3-11f9-40c5-817b-7100266a53b8 None admin] PATH_INFO: `/v3/services` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:33.761492 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eb4f3-11f9-40c5-817b-7100266a53b8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:01:33.761800 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eb4f3-11f9-40c5-817b-7100266a53b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:33.763213 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eb4f3-11f9-40c5-817b-7100266a53b8 None admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:33.768180 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 459/926] 10.222.0.65 () {56 vars in 1116 bytes} [Tue Jul 26 00:01:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:01:33.773920 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00815cad-682e-460e-9904-b1add00b4989 None admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:01:33.872081 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00815cad-682e-460e-9904-b1add00b4989 None admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:01:33.905152 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2cf9e-a7c6-4b8a-8cf8-dbb72ccf6357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:01:33.905700 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2cf9e-a7c6-4b8a-8cf8-dbb72ccf6357 None admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:01:33.905987 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2cf9e-a7c6-4b8a-8cf8-dbb72ccf6357 None admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:01:33.906260 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2cf9e-a7c6-4b8a-8cf8-dbb72ccf6357 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:01:33.907002 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2cf9e-a7c6-4b8a-8cf8-dbb72ccf6357 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:01:33.908366 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2cf9e-a7c6-4b8a-8cf8-dbb72ccf6357 None admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:01:33.927829 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 468/927] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Jul 26 00:01:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 00:01:43.765275 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=30 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:01:43.923464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:02:32.772391 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32d955-22d8-44f1-beb9-5fb5cdbb6d03 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:32.772890 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32d955-22d8-44f1-beb9-5fb5cdbb6d03 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:32.772978 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32d955-22d8-44f1-beb9-5fb5cdbb6d03 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:32.774565 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 460/928] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:02:32.781379 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37fd2-9d8a-4cd3-8d4f-bb8fbfed496e None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:32.781871 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37fd2-9d8a-4cd3-8d4f-bb8fbfed496e None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:32.781953 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37fd2-9d8a-4cd3-8d4f-bb8fbfed496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:32.807234 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-f9a37fd2-9d8a-4cd3-8d4f-bb8fbfed496e None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:02:32.810065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-f9a37fd2-9d8a-4cd3-8d4f-bb8fbfed496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:02:32.944567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 469/929] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:02:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:02:32.999718 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e195-7173-44f4-9476-27f26a2b2e23 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:33.000038 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e195-7173-44f4-9476-27f26a2b2e23 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:33.000285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e195-7173-44f4-9476-27f26a2b2e23 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:33.001767 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 461/930] 10.222.0.65 () {54 vars in 965 bytes} [Tue Jul 26 00:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:02:33.009122 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca5977-8af9-4d3c-bcc8-44f4f5fa5051 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:33.009753 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca5977-8af9-4d3c-bcc8-44f4f5fa5051 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:33.010278 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca5977-8af9-4d3c-bcc8-44f4f5fa5051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:33.102531 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-e4ca5977-8af9-4d3c-bcc8-44f4f5fa5051 None None] MFA Rules not processed for user `d4e34b7f817f452faabd2d32d1af3ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:02:33.104179 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-e4ca5977-8af9-4d3c-bcc8-44f4f5fa5051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:02:33.181731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 470/931] 10.222.0.65 () {58 vars in 1062 bytes} [Tue Jul 26 00:02:33 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:02:33.193186 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9e195-7173-44f4-9476-27f26a2b2e23 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:02:33.209272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9e195-7173-44f4-9476-27f26a2b2e23 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:02:33.214664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104e2f8-b7b5-4de6-9e69-383fd5ecb89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:02:33.215723 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104e2f8-b7b5-4de6-9e69-383fd5ecb89d service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:33.216211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104e2f8-b7b5-4de6-9e69-383fd5ecb89d service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:33.216687 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104e2f8-b7b5-4de6-9e69-383fd5ecb89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:33.231319 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104e2f8-b7b5-4de6-9e69-383fd5ecb89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:02:33.233500 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104e2f8-b7b5-4de6-9e69-383fd5ecb89d service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:02:33.250813 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 462/932] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:02:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:02:35.762476 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dd570-6388-4f36-9556-e1c7ee5ad12c None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:35.763078 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dd570-6388-4f36-9556-e1c7ee5ad12c None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:35.763078 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dd570-6388-4f36-9556-e1c7ee5ad12c None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:35.764408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 471/933] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:02:35.769700 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb3875-0b2c-4bc8-ac8a-5ac3ddcb58af None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:35.770108 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb3875-0b2c-4bc8-ac8a-5ac3ddcb58af None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:35.770260 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb3875-0b2c-4bc8-ac8a-5ac3ddcb58af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:35.790215 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-c4fb3875-0b2c-4bc8-ac8a-5ac3ddcb58af None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:02:35.791435 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-c4fb3875-0b2c-4bc8-ac8a-5ac3ddcb58af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:02:35.800180 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 463/934] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:02:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:02:35.840604 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dd570-6388-4f36-9556-e1c7ee5ad12c None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:02:35.851548 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dd570-6388-4f36-9556-e1c7ee5ad12c None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:02:35.855531 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002072ae-3530-407e-9ae4-f48c1ee9ed6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:02:35.856131 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002072ae-3530-407e-9ae4-f48c1ee9ed6a service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:35.856411 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002072ae-3530-407e-9ae4-f48c1ee9ed6a service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:35.856685 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002072ae-3530-407e-9ae4-f48c1ee9ed6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:35.865699 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002072ae-3530-407e-9ae4-f48c1ee9ed6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:02:35.867171 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002072ae-3530-407e-9ae4-f48c1ee9ed6a service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:02:35.877544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 472/935] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:02:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:02:38.438828 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59d095-1766-46de-9830-2ffdac9b8af8 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:38.439355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59d095-1766-46de-9830-2ffdac9b8af8 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:38.439355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59d095-1766-46de-9830-2ffdac9b8af8 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:38.440872 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 464/936] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:02:38.445907 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924af21-6fc1-4c61-8baf-293e3b433c43 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:38.446354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924af21-6fc1-4c61-8baf-293e3b433c43 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:38.446502 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924af21-6fc1-4c61-8baf-293e3b433c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:38.485875 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-e924af21-6fc1-4c61-8baf-293e3b433c43 None None] MFA Rules not processed for user `daabac9b68d84dcdb04232880864f2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:02:38.487104 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-e924af21-6fc1-4c61-8baf-293e3b433c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:02:38.529703 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:02:38.562754 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 473/937] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:02:38 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:02:38.601080 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59d095-1766-46de-9830-2ffdac9b8af8 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:02:38.613729 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59d095-1766-46de-9830-2ffdac9b8af8 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:02:38.617479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf5120-e7d0-4348-bdfb-6dacb4ba2e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:02:38.618174 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5120-e7d0-4348-bdfb-6dacb4ba2e4b service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:38.618530 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5120-e7d0-4348-bdfb-6dacb4ba2e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:38.618912 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5120-e7d0-4348-bdfb-6dacb4ba2e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:38.628836 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf5120-e7d0-4348-bdfb-6dacb4ba2e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:02:38.630366 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf5120-e7d0-4348-bdfb-6dacb4ba2e4b service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:02:38.640699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 465/938] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:02:38 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:02:41.459203 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90474e-ef6b-4531-a12f-f465fb24b6b6 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:41.459730 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90474e-ef6b-4531-a12f-f465fb24b6b6 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:41.459730 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90474e-ef6b-4531-a12f-f465fb24b6b6 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:41.461066 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 474/939] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:02:41.466731 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7ee13-6b39-49f3-a8f3-2603562d36f1 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:41.467153 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7ee13-6b39-49f3-a8f3-2603562d36f1 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:41.467309 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7ee13-6b39-49f3-a8f3-2603562d36f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:41.486402 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-38c7ee13-6b39-49f3-a8f3-2603562d36f1 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:02:41.487672 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-38c7ee13-6b39-49f3-a8f3-2603562d36f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:02:41.553353 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 466/940] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:02:41 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:02:41.593192 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90474e-ef6b-4531-a12f-f465fb24b6b6 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:02:41.603459 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90474e-ef6b-4531-a12f-f465fb24b6b6 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:02:41.607046 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90d6e3-3afd-444f-892d-ebebaff321b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:02:41.607638 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90d6e3-3afd-444f-892d-ebebaff321b5 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:41.607914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90d6e3-3afd-444f-892d-ebebaff321b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:41.608182 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90d6e3-3afd-444f-892d-ebebaff321b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:41.616787 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90d6e3-3afd-444f-892d-ebebaff321b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:02:41.618191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90d6e3-3afd-444f-892d-ebebaff321b5 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:02:41.627453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 475/941] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:02:41 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:02:44.519048 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5291d-f0ef-462f-a488-0a5579f7ab94 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:44.519576 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5291d-f0ef-462f-a488-0a5579f7ab94 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:44.519688 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5291d-f0ef-462f-a488-0a5579f7ab94 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:44.520965 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 467/942] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:02:44.526655 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4f36f-91c2-47ae-beb4-a518c484e1ef None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:44.527107 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4f36f-91c2-47ae-beb4-a518c484e1ef None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:44.527220 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4f36f-91c2-47ae-beb4-a518c484e1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:44.546862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-a7d4f36f-91c2-47ae-beb4-a518c484e1ef None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:02:44.548052 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-a7d4f36f-91c2-47ae-beb4-a518c484e1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:02:44.555988 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 476/943] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:02:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:02:44.608227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f94c7-2bb8-4a2e-a7b0-b60a496c0936 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:44.608612 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f94c7-2bb8-4a2e-a7b0-b60a496c0936 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:44.608960 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f94c7-2bb8-4a2e-a7b0-b60a496c0936 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:44.610397 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 468/944] 10.222.0.65 () {54 vars in 965 bytes} [Tue Jul 26 00:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:02:44.616528 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c304d0-33c5-4ec1-be53-15850712d66a None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:44.616817 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c304d0-33c5-4ec1-be53-15850712d66a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:44.617091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c304d0-33c5-4ec1-be53-15850712d66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:44.637039 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-86c304d0-33c5-4ec1-be53-15850712d66a None None] MFA Rules not processed for user `d4e34b7f817f452faabd2d32d1af3ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:02:44.638220 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-86c304d0-33c5-4ec1-be53-15850712d66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:02:44.644510 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 477/945] 10.222.0.65 () {58 vars in 1062 bytes} [Tue Jul 26 00:02:44 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:02:44.654119 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f94c7-2bb8-4a2e-a7b0-b60a496c0936 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:02:44.667060 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f94c7-2bb8-4a2e-a7b0-b60a496c0936 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:02:44.670634 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ce809-0c81-4e84-bfd0-48c1c07d7df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:02:44.671275 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce809-0c81-4e84-bfd0-48c1c07d7df5 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:44.671555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce809-0c81-4e84-bfd0-48c1c07d7df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:44.671898 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce809-0c81-4e84-bfd0-48c1c07d7df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:44.682150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ce809-0c81-4e84-bfd0-48c1c07d7df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:02:44.684318 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ce809-0c81-4e84-bfd0-48c1c07d7df5 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:02:44.693975 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 469/946] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:02:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:02:47.189043 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae0a99-83f8-49e3-948c-e28fe605aa0d None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:47.189587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae0a99-83f8-49e3-948c-e28fe605aa0d None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:47.189587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae0a99-83f8-49e3-948c-e28fe605aa0d None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:47.190960 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 478/947] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:02:47.196285 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f96619-118b-48da-9717-e0640ccd4912 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:47.196683 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f96619-118b-48da-9717-e0640ccd4912 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:47.196834 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f96619-118b-48da-9717-e0640ccd4912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:47.216685 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-68f96619-118b-48da-9717-e0640ccd4912 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:02:47.217884 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-68f96619-118b-48da-9717-e0640ccd4912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:02:47.225812 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 470/948] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:02:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:02:47.262498 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae0a99-83f8-49e3-948c-e28fe605aa0d None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:02:47.273127 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae0a99-83f8-49e3-948c-e28fe605aa0d None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:02:47.277205 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d3647-233b-43cb-aa3d-d02b3fc1f735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:02:47.277807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3647-233b-43cb-aa3d-d02b3fc1f735 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:47.278087 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3647-233b-43cb-aa3d-d02b3fc1f735 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:47.278361 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3647-233b-43cb-aa3d-d02b3fc1f735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:47.287292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d3647-233b-43cb-aa3d-d02b3fc1f735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:02:47.288703 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d3647-233b-43cb-aa3d-d02b3fc1f735 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:02:47.298567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 479/949] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:02:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:02:49.584213 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8261f7-ac99-48b1-a6a6-ccdf5f825fc5 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:49.584786 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8261f7-ac99-48b1-a6a6-ccdf5f825fc5 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:49.584786 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8261f7-ac99-48b1-a6a6-ccdf5f825fc5 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:49.586159 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 471/950] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:02:49.592062 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48133df2-f257-4a88-ac7a-aaf55a033e5a None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:49.592526 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48133df2-f257-4a88-ac7a-aaf55a033e5a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:49.592634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48133df2-f257-4a88-ac7a-aaf55a033e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:49.612167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-48133df2-f257-4a88-ac7a-aaf55a033e5a None None] MFA Rules not processed for user `daabac9b68d84dcdb04232880864f2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:02:49.613343 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-48133df2-f257-4a88-ac7a-aaf55a033e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:02:49.621208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 480/951] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:02:49 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:02:49.659651 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8261f7-ac99-48b1-a6a6-ccdf5f825fc5 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:02:49.670859 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8261f7-ac99-48b1-a6a6-ccdf5f825fc5 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:02:49.674317 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e935e28-2318-4a6f-a57e-f6cb42066b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:02:49.674947 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935e28-2318-4a6f-a57e-f6cb42066b88 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:49.675231 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935e28-2318-4a6f-a57e-f6cb42066b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:49.675532 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935e28-2318-4a6f-a57e-f6cb42066b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:49.688224 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e935e28-2318-4a6f-a57e-f6cb42066b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:02:49.690035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e935e28-2318-4a6f-a57e-f6cb42066b88 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:02:49.700855 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 472/952] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:02:49 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:02:52.331914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07853dd7-bba3-4d7f-96cc-6e3c34b6c1c3 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:52.332439 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07853dd7-bba3-4d7f-96cc-6e3c34b6c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:52.332439 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07853dd7-bba3-4d7f-96cc-6e3c34b6c1c3 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:52.333711 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 481/953] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:02:52.339250 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88d98a-c1de-49a6-be84-1c81644a25df None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:52.339686 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88d98a-c1de-49a6-be84-1c81644a25df None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:52.339952 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88d98a-c1de-49a6-be84-1c81644a25df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:52.360532 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-da88d98a-c1de-49a6-be84-1c81644a25df None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:02:52.361736 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-da88d98a-c1de-49a6-be84-1c81644a25df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:02:52.370401 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 473/954] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:02:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:02:52.407161 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07853dd7-bba3-4d7f-96cc-6e3c34b6c1c3 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:02:52.418242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07853dd7-bba3-4d7f-96cc-6e3c34b6c1c3 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:02:52.421799 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a5be7-a516-424e-8b20-0beb490e63dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:02:52.422513 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5be7-a516-424e-8b20-0beb490e63dd service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:52.423163 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5be7-a516-424e-8b20-0beb490e63dd service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:52.423366 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5be7-a516-424e-8b20-0beb490e63dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:52.434091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a5be7-a516-424e-8b20-0beb490e63dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:02:52.435581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a5be7-a516-424e-8b20-0beb490e63dd service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:02:52.446262 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 482/955] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:02:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:02:54.697276 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce7eee-4bd3-410b-92b4-cd0e95777789 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:54.698393 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce7eee-4bd3-410b-92b4-cd0e95777789 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:54.698393 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce7eee-4bd3-410b-92b4-cd0e95777789 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:54.699862 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 474/956] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:02:54.704919 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258eefe-9719-42b1-b914-cc1742684d01 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:54.705344 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258eefe-9719-42b1-b914-cc1742684d01 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:54.705475 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258eefe-9719-42b1-b914-cc1742684d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:54.726619 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-d258eefe-9719-42b1-b914-cc1742684d01 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:02:54.727826 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-d258eefe-9719-42b1-b914-cc1742684d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:02:54.735852 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 483/957] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:02:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:02:54.777820 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce7eee-4bd3-410b-92b4-cd0e95777789 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:02:54.783326 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=65 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:02:54.789398 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce7eee-4bd3-410b-92b4-cd0e95777789 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:02:54.793457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe43c0-cc20-4385-9524-3c3935514eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:02:54.794466 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe43c0-cc20-4385-9524-3c3935514eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:54.794786 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe43c0-cc20-4385-9524-3c3935514eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:54.795063 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe43c0-cc20-4385-9524-3c3935514eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:54.804305 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe43c0-cc20-4385-9524-3c3935514eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:02:54.805737 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe43c0-cc20-4385-9524-3c3935514eb3 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:02:54.816548 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 475/958] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:02:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:02:57.535189 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917ab05-e50f-4603-944d-b05292900a4a None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:57.535746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917ab05-e50f-4603-944d-b05292900a4a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:57.535746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917ab05-e50f-4603-944d-b05292900a4a None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:57.537045 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 484/959] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:02:57.542873 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9b658-7dd0-44fb-8fbf-c05c5e024186 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:57.543296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9b658-7dd0-44fb-8fbf-c05c5e024186 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:57.543445 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9b658-7dd0-44fb-8fbf-c05c5e024186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:57.562838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-67e9b658-7dd0-44fb-8fbf-c05c5e024186 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:02:57.564013 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-67e9b658-7dd0-44fb-8fbf-c05c5e024186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:02:57.571524 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 476/960] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:02:57 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:02:57.607826 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917ab05-e50f-4603-944d-b05292900a4a None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:02:57.618074 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917ab05-e50f-4603-944d-b05292900a4a None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:02:57.622106 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b41f7e-e580-4fc8-a72e-82f2f2095eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:02:57.622691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b41f7e-e580-4fc8-a72e-82f2f2095eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:02:57.622996 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b41f7e-e580-4fc8-a72e-82f2f2095eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:02:57.623264 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b41f7e-e580-4fc8-a72e-82f2f2095eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:02:57.631815 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b41f7e-e580-4fc8-a72e-82f2f2095eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:02:57.633207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b41f7e-e580-4fc8-a72e-82f2f2095eb5 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:02:57.642232 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 485/961] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:02:57 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:01.884916 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094e0ff-fda8-4e9b-b1b9-ce0490809cbb None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:01.885608 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094e0ff-fda8-4e9b-b1b9-ce0490809cbb None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:01.885833 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094e0ff-fda8-4e9b-b1b9-ce0490809cbb None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:01.887303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 477/962] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:01.892508 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2c43a-5021-4720-93d5-8b5133ecd94c None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:01.892949 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2c43a-5021-4720-93d5-8b5133ecd94c None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:01.893171 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2c43a-5021-4720-93d5-8b5133ecd94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:01.912000 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-c0c2c43a-5021-4720-93d5-8b5133ecd94c None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:01.913169 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-c0c2c43a-5021-4720-93d5-8b5133ecd94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:01.921618 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 486/963] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:01.962300 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094e0ff-fda8-4e9b-b1b9-ce0490809cbb None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:01.973295 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094e0ff-fda8-4e9b-b1b9-ce0490809cbb None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:01.976765 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743f12c-2994-4472-bd25-9cdc929309a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:01.977367 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743f12c-2994-4472-bd25-9cdc929309a2 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:01.977657 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743f12c-2994-4472-bd25-9cdc929309a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:01.977928 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743f12c-2994-4472-bd25-9cdc929309a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:01.987909 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743f12c-2994-4472-bd25-9cdc929309a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:01.989368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743f12c-2994-4472-bd25-9cdc929309a2 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:01.999443 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 478/964] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:04.882867 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611339c8-4284-409f-a934-54f5d7ed23ac None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:04.883466 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611339c8-4284-409f-a934-54f5d7ed23ac None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:04.883746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611339c8-4284-409f-a934-54f5d7ed23ac None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:04.885159 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 487/965] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:04.890422 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fdea9-b468-4d59-a39e-237b7770bb38 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:04.890866 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fdea9-b468-4d59-a39e-237b7770bb38 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:04.891083 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fdea9-b468-4d59-a39e-237b7770bb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:04.910098 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-be6fdea9-b468-4d59-a39e-237b7770bb38 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:04.911310 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-be6fdea9-b468-4d59-a39e-237b7770bb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:04.920148 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 479/966] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:04 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:04.958875 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611339c8-4284-409f-a934-54f5d7ed23ac None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:04.970253 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611339c8-4284-409f-a934-54f5d7ed23ac None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:04.973731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7b146-70b1-4346-9877-91a3e41a5058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:04.974342 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7b146-70b1-4346-9877-91a3e41a5058 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:04.974616 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7b146-70b1-4346-9877-91a3e41a5058 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:04.974923 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7b146-70b1-4346-9877-91a3e41a5058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:04.984542 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7b146-70b1-4346-9877-91a3e41a5058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:04.985966 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7b146-70b1-4346-9877-91a3e41a5058 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:04.996259 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 488/967] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:04 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:09.142890 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8409c4-197b-4d2e-8a31-404260de9a3a None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:09.143405 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8409c4-197b-4d2e-8a31-404260de9a3a None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:09.143498 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8409c4-197b-4d2e-8a31-404260de9a3a None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:09.144778 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 480/968] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:09.149820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349f459-12af-4f26-83ec-f94f5afaf87e None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:09.150990 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349f459-12af-4f26-83ec-f94f5afaf87e None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:09.150990 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349f459-12af-4f26-83ec-f94f5afaf87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:09.158270 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=57 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:03:09.171131 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-1349f459-12af-4f26-83ec-f94f5afaf87e None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:09.172300 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-1349f459-12af-4f26-83ec-f94f5afaf87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:09.179991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 489/969] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:03:09.219463 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8409c4-197b-4d2e-8a31-404260de9a3a None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:09.230870 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8409c4-197b-4d2e-8a31-404260de9a3a None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:09.234299 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca87c-060b-4355-943b-5bb101edb32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:09.234929 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca87c-060b-4355-943b-5bb101edb32e service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:09.235211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca87c-060b-4355-943b-5bb101edb32e service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:09.235486 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca87c-060b-4355-943b-5bb101edb32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:09.244588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eca87c-060b-4355-943b-5bb101edb32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:09.245898 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eca87c-060b-4355-943b-5bb101edb32e service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:09.255121 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 481/970] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:14.699291 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a534a52-f6f0-402a-9262-b8c7ae1a3bf4 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:14.700307 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a534a52-f6f0-402a-9262-b8c7ae1a3bf4 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:14.700743 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a534a52-f6f0-402a-9262-b8c7ae1a3bf4 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:14.702395 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 490/971] 10.222.0.65 () {54 vars in 921 bytes} [Tue Jul 26 00:03:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:14.708357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd593319-72a3-4dc8-9e09-672418af8bd2 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:14.709873 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd593319-72a3-4dc8-9e09-672418af8bd2 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:14.710303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd593319-72a3-4dc8-9e09-672418af8bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:14.775502 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-fd593319-72a3-4dc8-9e09-672418af8bd2 None None] MFA Rules not processed for user `d88b351fcdad4f2ab1a42e2ac3ee0856`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:14.777581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-fd593319-72a3-4dc8-9e09-672418af8bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:14.864647 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 482/972] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Jul 26 00:03:14 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:19.172086 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=2 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:03:19.467388 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d0acf-c236-4bd8-9635-bef5291e0cca None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:19.467744 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d0acf-c236-4bd8-9635-bef5291e0cca None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:19.467942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d0acf-c236-4bd8-9635-bef5291e0cca None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:19.469487 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 491/973] 10.222.0.65 () {54 vars in 921 bytes} [Tue Jul 26 00:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:19.474399 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01532-147e-4579-9f61-703d5c32df5d None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:19.474923 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01532-147e-4579-9f61-703d5c32df5d None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:19.475005 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01532-147e-4579-9f61-703d5c32df5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:19.497620 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-b7a01532-147e-4579-9f61-703d5c32df5d None None] MFA Rules not processed for user `d88b351fcdad4f2ab1a42e2ac3ee0856`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:19.499161 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-b7a01532-147e-4579-9f61-703d5c32df5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:19.507921 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 483/974] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Jul 26 00:03:19 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:20.976301 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b98c9-a4cc-4624-9a2b-a04b0394ad0a None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:20.976889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b98c9-a4cc-4624-9a2b-a04b0394ad0a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:20.976889 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b98c9-a4cc-4624-9a2b-a04b0394ad0a None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:20.978621 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 492/975] 10.222.0.65 () {54 vars in 921 bytes} [Tue Jul 26 00:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:20.986357 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236094a-6ded-4ea8-8386-ce9b1f8bdff3 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:20.986808 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236094a-6ded-4ea8-8386-ce9b1f8bdff3 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:20.986985 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236094a-6ded-4ea8-8386-ce9b1f8bdff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:21.007276 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-5236094a-6ded-4ea8-8386-ce9b1f8bdff3 None None] MFA Rules not processed for user `d88b351fcdad4f2ab1a42e2ac3ee0856`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:21.008680 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-5236094a-6ded-4ea8-8386-ce9b1f8bdff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:21.018056 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 484/976] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Jul 26 00:03:20 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:24.977545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc79ca-ed63-4093-bddc-844d2bf7c683 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:24.978928 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc79ca-ed63-4093-bddc-844d2bf7c683 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:24.978928 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc79ca-ed63-4093-bddc-844d2bf7c683 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:24.980639 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 493/977] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:24.989889 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb408f-0211-4832-8951-39b3c0643ce0 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:24.990271 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb408f-0211-4832-8951-39b3c0643ce0 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:24.990733 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb408f-0211-4832-8951-39b3c0643ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:24.998273 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=69 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:03:25.011221 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-2ebb408f-0211-4832-8951-39b3c0643ce0 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:25.012536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-2ebb408f-0211-4832-8951-39b3c0643ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:25.020808 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 485/978] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:25.078271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291454f-6ade-4a5c-b784-a13c85ab508e None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:25.078966 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291454f-6ade-4a5c-b784-a13c85ab508e None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:25.079466 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291454f-6ade-4a5c-b784-a13c85ab508e None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:25.080996 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 494/979] 10.222.0.65 () {54 vars in 962 bytes} [Tue Jul 26 00:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:25.089166 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abea2f-85d3-4ff3-b1fe-0f08e073fabe None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:25.089820 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abea2f-85d3-4ff3-b1fe-0f08e073fabe None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:25.090305 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abea2f-85d3-4ff3-b1fe-0f08e073fabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:25.129582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-15abea2f-85d3-4ff3-b1fe-0f08e073fabe None None] MFA Rules not processed for user `a513753b2f49408baf24402f1fa3c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:25.130936 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-15abea2f-85d3-4ff3-b1fe-0f08e073fabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:25.212774 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 486/980] 10.222.0.65 () {58 vars in 1059 bytes} [Tue Jul 26 00:03:25 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:03:25.220685 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291454f-6ade-4a5c-b784-a13c85ab508e None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:25.235272 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291454f-6ade-4a5c-b784-a13c85ab508e None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:25.241521 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c825d-79f9-43b1-96a8-ad14a154d525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:25.242125 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c825d-79f9-43b1-96a8-ad14a154d525 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:25.242406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c825d-79f9-43b1-96a8-ad14a154d525 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:25.242678 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c825d-79f9-43b1-96a8-ad14a154d525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:25.252141 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c825d-79f9-43b1-96a8-ad14a154d525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:25.253699 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c825d-79f9-43b1-96a8-ad14a154d525 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:25.263509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 495/981] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 00:03:27.745511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d14e4-d890-47f5-9eba-74160c6629cf None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:27.746064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d14e4-d890-47f5-9eba-74160c6629cf None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:27.746064 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d14e4-d890-47f5-9eba-74160c6629cf None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:27.747587 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 487/982] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:27.752731 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf64e5e-7a50-49c1-8f87-87e194b7cedb None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:27.753117 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf64e5e-7a50-49c1-8f87-87e194b7cedb None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:27.753304 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf64e5e-7a50-49c1-8f87-87e194b7cedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:27.775226 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-4bf64e5e-7a50-49c1-8f87-87e194b7cedb None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:27.776630 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-4bf64e5e-7a50-49c1-8f87-87e194b7cedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:27.785153 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 496/983] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:27.830581 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d14e4-d890-47f5-9eba-74160c6629cf None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:27.845014 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d14e4-d890-47f5-9eba-74160c6629cf None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:27.850332 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac89dad-35b5-4530-b6fb-846e1aed7176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:27.851050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac89dad-35b5-4530-b6fb-846e1aed7176 service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:27.851410 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac89dad-35b5-4530-b6fb-846e1aed7176 service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:27.851768 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac89dad-35b5-4530-b6fb-846e1aed7176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:27.860540 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac89dad-35b5-4530-b6fb-846e1aed7176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:27.862207 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac89dad-35b5-4530-b6fb-846e1aed7176 service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:27.873043 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 488/984] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:30.435443 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14933e-c73c-481a-9bc9-d7d6e7cc8eb0 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:30.435980 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14933e-c73c-481a-9bc9-d7d6e7cc8eb0 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:30.436091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14933e-c73c-481a-9bc9-d7d6e7cc8eb0 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:30.437551 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 497/985] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:30.442936 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa6067-6635-4eb1-a2ef-a276005c5098 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:30.443786 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa6067-6635-4eb1-a2ef-a276005c5098 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:30.444067 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa6067-6635-4eb1-a2ef-a276005c5098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:30.469140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-5cfa6067-6635-4eb1-a2ef-a276005c5098 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:30.471877 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-5cfa6067-6635-4eb1-a2ef-a276005c5098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:30.485070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 489/986] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:30.535375 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8f1ef-8a4e-493d-a752-df68e80b6f0f None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:30.535656 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8f1ef-8a4e-493d-a752-df68e80b6f0f None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:30.535927 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8f1ef-8a4e-493d-a752-df68e80b6f0f None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:30.537306 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 498/987] 10.222.0.65 () {54 vars in 962 bytes} [Tue Jul 26 00:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:30.543339 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49314b5-f7f1-4dc4-b611-1a2d7bf2e249 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:30.543635 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49314b5-f7f1-4dc4-b611-1a2d7bf2e249 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:30.543915 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49314b5-f7f1-4dc4-b611-1a2d7bf2e249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:30.564056 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-b49314b5-f7f1-4dc4-b611-1a2d7bf2e249 None None] MFA Rules not processed for user `a513753b2f49408baf24402f1fa3c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:30.565246 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-b49314b5-f7f1-4dc4-b611-1a2d7bf2e249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:30.573869 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 490/988] 10.222.0.65 () {58 vars in 1059 bytes} [Tue Jul 26 00:03:30 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:30.581672 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8f1ef-8a4e-493d-a752-df68e80b6f0f None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:30.595101 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8f1ef-8a4e-493d-a752-df68e80b6f0f None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:30.600625 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8d524-dcab-4d9a-b741-c58b55bbb929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:30.601234 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8d524-dcab-4d9a-b741-c58b55bbb929 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:30.601513 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8d524-dcab-4d9a-b741-c58b55bbb929 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:30.601794 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8d524-dcab-4d9a-b741-c58b55bbb929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:30.610879 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8d524-dcab-4d9a-b741-c58b55bbb929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:30.612458 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8d524-dcab-4d9a-b741-c58b55bbb929 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:30.622345 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 499/989] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:32.965123 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fcacc-ea11-4718-9347-85d7a9521ba1 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:32.965685 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fcacc-ea11-4718-9347-85d7a9521ba1 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:32.965685 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fcacc-ea11-4718-9347-85d7a9521ba1 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:32.967538 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 491/990] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:32.973291 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77851d79-b52a-4d81-9dce-f0a3f5635ce3 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:32.980289 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77851d79-b52a-4d81-9dce-f0a3f5635ce3 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:32.980776 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77851d79-b52a-4d81-9dce-f0a3f5635ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:33.010988 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-77851d79-b52a-4d81-9dce-f0a3f5635ce3 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:33.012566 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-77851d79-b52a-4d81-9dce-f0a3f5635ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:33.027056 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 500/991] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:33.070516 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fcacc-ea11-4718-9347-85d7a9521ba1 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:33.087116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fcacc-ea11-4718-9347-85d7a9521ba1 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:33.092561 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d57085-a096-49e0-a398-01371daee9d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:33.093351 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d57085-a096-49e0-a398-01371daee9d0 service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:33.094016 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d57085-a096-49e0-a398-01371daee9d0 service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:33.094439 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d57085-a096-49e0-a398-01371daee9d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:33.104720 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d57085-a096-49e0-a398-01371daee9d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:33.106547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d57085-a096-49e0-a398-01371daee9d0 service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:33.116981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 492/992] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:34.908853 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061c540-92ca-4d27-bc77-654a73082f6f None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:34.910016 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061c540-92ca-4d27-bc77-654a73082f6f None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:34.910876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061c540-92ca-4d27-bc77-654a73082f6f None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:34.914915 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 501/993] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:34.920181 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d278ad-4c25-429e-a2d7-9565345c7a13 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:34.920606 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d278ad-4c25-429e-a2d7-9565345c7a13 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:34.920819 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d278ad-4c25-429e-a2d7-9565345c7a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:34.965036 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-59d278ad-4c25-429e-a2d7-9565345c7a13 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:34.968181 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-59d278ad-4c25-429e-a2d7-9565345c7a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:35.024276 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 493/994] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:35.348162 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8fe54-a268-4321-b06b-ed3a544ae808 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:35.348378 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8fe54-a268-4321-b06b-ed3a544ae808 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:35.348557 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8fe54-a268-4321-b06b-ed3a544ae808 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:35.350747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 502/995] 10.222.0.65 () {54 vars in 964 bytes} [Tue Jul 26 00:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:35.356996 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e9479-1f24-4860-b19d-e3ca31dbeb43 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:35.357381 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e9479-1f24-4860-b19d-e3ca31dbeb43 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:35.357837 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e9479-1f24-4860-b19d-e3ca31dbeb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:35.404486 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-7e3e9479-1f24-4860-b19d-e3ca31dbeb43 None None] MFA Rules not processed for user `5f8a981708a34de5be7cda18eb8bb1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:35.405781 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-7e3e9479-1f24-4860-b19d-e3ca31dbeb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:35.465087 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280163be-ec10-4e27-829b-144640aebe07 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:35.465293 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280163be-ec10-4e27-829b-144640aebe07 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:35.465554 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280163be-ec10-4e27-829b-144640aebe07 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:35.466912 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 503/996] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 00:03:35.471358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 494/997] 10.222.0.65 () {58 vars in 1061 bytes} [Tue Jul 26 00:03:35 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:35.472097 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c781644-640e-4518-bc1c-4b91c471d5ac None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:35.472386 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c781644-640e-4518-bc1c-4b91c471d5ac None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:35.472729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c781644-640e-4518-bc1c-4b91c471d5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:35.479641 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e9479-1f24-4860-b19d-e3ca31dbeb43 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:35.487887 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e9479-1f24-4860-b19d-e3ca31dbeb43 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:35.491658 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a365f15-6e7c-4743-9901-f4a494352caf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8a981708a34de5be7cda18eb8bb1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:35.492349 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a365f15-6e7c-4743-9901-f4a494352caf service cinder] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:35.492627 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a365f15-6e7c-4743-9901-f4a494352caf service cinder] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:35.492803 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-8c781644-640e-4518-bc1c-4b91c471d5ac None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:35.493101 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a365f15-6e7c-4743-9901-f4a494352caf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:35.494778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-8c781644-640e-4518-bc1c-4b91c471d5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:35.502943 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 504/998] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:35.503926 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a365f15-6e7c-4743-9901-f4a494352caf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:35.505432 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a365f15-6e7c-4743-9901-f4a494352caf service cinder] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:35.510462 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:03:35.517595 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 495/999] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 00:03:35.548855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c781644-640e-4518-bc1c-4b91c471d5ac None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:35.561158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c781644-640e-4518-bc1c-4b91c471d5ac None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:35.566237 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453aeb35-61c7-47d1-bd96-f4dcf7d0f3dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:35.566960 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aeb35-61c7-47d1-bd96-f4dcf7d0f3dd service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:35.567307 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aeb35-61c7-47d1-bd96-f4dcf7d0f3dd service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:35.567648 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aeb35-61c7-47d1-bd96-f4dcf7d0f3dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:35.576728 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453aeb35-61c7-47d1-bd96-f4dcf7d0f3dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:35.578393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453aeb35-61c7-47d1-bd96-f4dcf7d0f3dd service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:35.587992 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 505/1000] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:37.926873 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8401755-d5fc-427e-a5b2-6636a01ce54e None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:37.927345 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8401755-d5fc-427e-a5b2-6636a01ce54e None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:37.927578 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8401755-d5fc-427e-a5b2-6636a01ce54e None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:37.929063 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 496/1001] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:37.934926 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88debe-1ac7-4713-8381-d38d6bc6e32f None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:37.935386 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88debe-1ac7-4713-8381-d38d6bc6e32f None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:37.935481 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88debe-1ac7-4713-8381-d38d6bc6e32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:37.956508 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-ed88debe-1ac7-4713-8381-d38d6bc6e32f None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:37.957715 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-ed88debe-1ac7-4713-8381-d38d6bc6e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:37.966409 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 506/1002] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:38.013612 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8401755-d5fc-427e-a5b2-6636a01ce54e None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:38.027489 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8401755-d5fc-427e-a5b2-6636a01ce54e None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:38.032449 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993a407-2d28-413c-aa56-5f5d7a34c57e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:38.033060 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993a407-2d28-413c-aa56-5f5d7a34c57e service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:38.033345 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993a407-2d28-413c-aa56-5f5d7a34c57e service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:38.033621 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993a407-2d28-413c-aa56-5f5d7a34c57e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:38.043763 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993a407-2d28-413c-aa56-5f5d7a34c57e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:38.045374 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993a407-2d28-413c-aa56-5f5d7a34c57e service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:38.056117 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 497/1003] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:40.338513 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e52a6-fb74-41f1-a785-8c86b1818e01 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:40.339072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e52a6-fb74-41f1-a785-8c86b1818e01 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:40.339072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e52a6-fb74-41f1-a785-8c86b1818e01 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:40.340416 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 507/1004] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:40.345743 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93af5-1308-4a29-a0c4-231bdc3e8e14 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:40.346559 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93af5-1308-4a29-a0c4-231bdc3e8e14 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:40.347028 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93af5-1308-4a29-a0c4-231bdc3e8e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:40.376528 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-c8b93af5-1308-4a29-a0c4-231bdc3e8e14 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:40.377881 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-c8b93af5-1308-4a29-a0c4-231bdc3e8e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:40.387368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 498/1005] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:40.428741 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e52a6-fb74-41f1-a785-8c86b1818e01 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:40.443853 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e52a6-fb74-41f1-a785-8c86b1818e01 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:40.448961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89253a09-0dba-4c82-a6e8-77cc419f8784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:40.449742 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89253a09-0dba-4c82-a6e8-77cc419f8784 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:40.450020 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89253a09-0dba-4c82-a6e8-77cc419f8784 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:40.450290 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89253a09-0dba-4c82-a6e8-77cc419f8784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:40.459013 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89253a09-0dba-4c82-a6e8-77cc419f8784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:40.460608 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89253a09-0dba-4c82-a6e8-77cc419f8784 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:40.471278 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 508/1006] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:42.742573 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356af85e-7219-479d-8f76-c4ffcdfa0694 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:42.743692 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356af85e-7219-479d-8f76-c4ffcdfa0694 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:42.743692 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356af85e-7219-479d-8f76-c4ffcdfa0694 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:42.745455 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 499/1007] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:42.750445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b865702-897e-49fc-b004-3dba12ec0fac None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:42.750876 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b865702-897e-49fc-b004-3dba12ec0fac None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:42.751072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b865702-897e-49fc-b004-3dba12ec0fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:42.771655 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-0b865702-897e-49fc-b004-3dba12ec0fac None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:42.773156 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-0b865702-897e-49fc-b004-3dba12ec0fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:42.783240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 509/1008] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:42.829727 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356af85e-7219-479d-8f76-c4ffcdfa0694 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:42.844529 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356af85e-7219-479d-8f76-c4ffcdfa0694 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:42.849912 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accff91-9839-418e-8080-0d30dcc6330c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:42.850636 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accff91-9839-418e-8080-0d30dcc6330c service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:42.851059 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accff91-9839-418e-8080-0d30dcc6330c service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:42.851437 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accff91-9839-418e-8080-0d30dcc6330c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:42.860896 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accff91-9839-418e-8080-0d30dcc6330c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:42.862593 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accff91-9839-418e-8080-0d30dcc6330c service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:42.873438 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 500/1009] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:45.184862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6623e-3b1a-407c-847f-787810a1a083 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:45.185422 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6623e-3b1a-407c-847f-787810a1a083 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:45.185422 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6623e-3b1a-407c-847f-787810a1a083 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:45.186764 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 510/1010] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 00:03:45.192377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b25cd-ceb0-4600-9fcd-9db5d8105065 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:45.192958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b25cd-ceb0-4600-9fcd-9db5d8105065 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:45.192958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b25cd-ceb0-4600-9fcd-9db5d8105065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:45.213245 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-d52b25cd-ceb0-4600-9fcd-9db5d8105065 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:45.214437 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-d52b25cd-ceb0-4600-9fcd-9db5d8105065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:45.222153 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 501/1011] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:45.269228 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6623e-3b1a-407c-847f-787810a1a083 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:45.283606 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6623e-3b1a-407c-847f-787810a1a083 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:45.288697 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de1d30-b6f1-4209-a989-edba5f9a88d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:45.289329 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de1d30-b6f1-4209-a989-edba5f9a88d0 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:45.289569 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de1d30-b6f1-4209-a989-edba5f9a88d0 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:45.289846 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de1d30-b6f1-4209-a989-edba5f9a88d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:45.298336 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de1d30-b6f1-4209-a989-edba5f9a88d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:45.300002 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de1d30-b6f1-4209-a989-edba5f9a88d0 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:45.310577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 511/1012] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:47.968476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bc65d-0f47-4765-8a90-72ecd6b4635d None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:47.969145 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bc65d-0f47-4765-8a90-72ecd6b4635d None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:47.969145 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bc65d-0f47-4765-8a90-72ecd6b4635d None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:47.970421 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 502/1013] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:47.975843 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ef407-0ff3-43f8-9ee3-72607f6c7a56 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:47.976328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ef407-0ff3-43f8-9ee3-72607f6c7a56 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:47.976428 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ef407-0ff3-43f8-9ee3-72607f6c7a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:47.996218 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-a67ef407-0ff3-43f8-9ee3-72607f6c7a56 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:47.997401 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-a67ef407-0ff3-43f8-9ee3-72607f6c7a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:48.005669 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 512/1014] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:03:48.056718 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bc65d-0f47-4765-8a90-72ecd6b4635d None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:48.070181 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bc65d-0f47-4765-8a90-72ecd6b4635d None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:48.075173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503f72f-e49e-47a9-bb51-d94c7e5afa54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:48.075778 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f72f-e49e-47a9-bb51-d94c7e5afa54 service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:48.076065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f72f-e49e-47a9-bb51-d94c7e5afa54 service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:48.076336 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f72f-e49e-47a9-bb51-d94c7e5afa54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:48.084730 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503f72f-e49e-47a9-bb51-d94c7e5afa54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:48.086320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503f72f-e49e-47a9-bb51-d94c7e5afa54 service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:48.098432 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 503/1015] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:50.875915 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312cc9f-a13f-482a-a73f-37d1097948a3 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:50.876611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312cc9f-a13f-482a-a73f-37d1097948a3 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:50.876611 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312cc9f-a13f-482a-a73f-37d1097948a3 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:50.877804 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 513/1016] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:50.883099 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d66a3-368a-4c97-86e4-551012676cdb None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:50.884061 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d66a3-368a-4c97-86e4-551012676cdb None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:50.884176 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d66a3-368a-4c97-86e4-551012676cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:50.903877 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-e43d66a3-368a-4c97-86e4-551012676cdb None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:50.905067 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-e43d66a3-368a-4c97-86e4-551012676cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:50.912802 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 504/1017] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:50.959355 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312cc9f-a13f-482a-a73f-37d1097948a3 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:50.967721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=49 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:03:50.977556 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312cc9f-a13f-482a-a73f-37d1097948a3 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:50.982402 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3c0f8-144a-4ffb-b933-04abd414f6c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:50.983045 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c0f8-144a-4ffb-b933-04abd414f6c3 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:50.983328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c0f8-144a-4ffb-b933-04abd414f6c3 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:50.983601 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c0f8-144a-4ffb-b933-04abd414f6c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:50.992216 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3c0f8-144a-4ffb-b933-04abd414f6c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:50.994444 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3c0f8-144a-4ffb-b933-04abd414f6c3 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:51.003714 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 514/1018] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:51.388237 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26fe3-c0b5-48ed-b287-ce697fc905c8 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:51.388577 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26fe3-c0b5-48ed-b287-ce697fc905c8 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:51.388805 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26fe3-c0b5-48ed-b287-ce697fc905c8 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:51.390166 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 505/1019] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:51.395374 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4608e0-2cba-46b6-93b3-690141dc4baa None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:51.395728 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4608e0-2cba-46b6-93b3-690141dc4baa None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:51.396075 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4608e0-2cba-46b6-93b3-690141dc4baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:51.416052 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-df4608e0-2cba-46b6-93b3-690141dc4baa None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:51.417238 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-df4608e0-2cba-46b6-93b3-690141dc4baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:51.424981 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 515/1020] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:51.482584 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0cb59-6dfc-4d07-837c-f3b674aec439 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:51.482909 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0cb59-6dfc-4d07-837c-f3b674aec439 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:51.483191 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0cb59-6dfc-4d07-837c-f3b674aec439 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:51.484537 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 506/1021] 10.222.0.65 () {54 vars in 966 bytes} [Tue Jul 26 00:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:51.489656 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559dea1-56ee-40f9-bfc9-3808c76bd08e None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:51.489957 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559dea1-56ee-40f9-bfc9-3808c76bd08e None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:51.490237 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559dea1-56ee-40f9-bfc9-3808c76bd08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:51.528711 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-2559dea1-56ee-40f9-bfc9-3808c76bd08e None None] MFA Rules not processed for user `cbc09289c7e645b189776f109b78968e`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:51.530002 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-2559dea1-56ee-40f9-bfc9-3808c76bd08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:51.590529 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 516/1022] 10.222.0.65 () {58 vars in 1063 bytes} [Tue Jul 26 00:03:51 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:51.598024 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0cb59-6dfc-4d07-837c-f3b674aec439 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:51.609683 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0cb59-6dfc-4d07-837c-f3b674aec439 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:51.613251 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcdeb7-7cd3-4a11-af56-857a013ff46d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc09289c7e645b189776f109b78968e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:51.613853 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcdeb7-7cd3-4a11-af56-857a013ff46d service glance] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:51.614135 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcdeb7-7cd3-4a11-af56-857a013ff46d service glance] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:51.614413 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcdeb7-7cd3-4a11-af56-857a013ff46d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:51.624391 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcdeb7-7cd3-4a11-af56-857a013ff46d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:51.625825 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcdeb7-7cd3-4a11-af56-857a013ff46d service glance] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:51.635813 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 507/1023] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:03:53.317265 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86dad3-29dc-4a97-a6de-aec28b4f0933 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:53.317907 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86dad3-29dc-4a97-a6de-aec28b4f0933 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:53.317907 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86dad3-29dc-4a97-a6de-aec28b4f0933 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:53.319190 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 517/1024] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:03:53.325432 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41975f20-45b4-4dac-acfc-489951cdc625 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:53.325900 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41975f20-45b4-4dac-acfc-489951cdc625 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:53.326055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41975f20-45b4-4dac-acfc-489951cdc625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:53.351014 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-41975f20-45b4-4dac-acfc-489951cdc625 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:03:53.352358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-41975f20-45b4-4dac-acfc-489951cdc625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:03:53.360200 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 508/1025] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:03:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:03:53.406845 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86dad3-29dc-4a97-a6de-aec28b4f0933 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:03:53.420365 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86dad3-29dc-4a97-a6de-aec28b4f0933 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:03:53.425495 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365a3c6-5f94-42bc-9de2-559e498e3906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:03:53.426112 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365a3c6-5f94-42bc-9de2-559e498e3906 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:03:53.426393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365a3c6-5f94-42bc-9de2-559e498e3906 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:03:53.426667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365a3c6-5f94-42bc-9de2-559e498e3906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:03:53.437208 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365a3c6-5f94-42bc-9de2-559e498e3906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:03:53.438856 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365a3c6-5f94-42bc-9de2-559e498e3906 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:03:53.451579 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 518/1026] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:03:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:03.342292 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=37 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:04:03.444189 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=47 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:04:06.861843 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f9e4e-ac0d-4965-80ee-b09f564ff10e None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:06.862529 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f9e4e-ac0d-4965-80ee-b09f564ff10e None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:06.862529 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f9e4e-ac0d-4965-80ee-b09f564ff10e None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:06.863781 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 509/1027] 10.222.0.65 () {54 vars in 918 bytes} [Tue Jul 26 00:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:06.869620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb876-2bda-4814-aa82-e94b7ef74a0d None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:06.870089 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb876-2bda-4814-aa82-e94b7ef74a0d None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:06.870203 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb876-2bda-4814-aa82-e94b7ef74a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:06.890349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-69ccb876-2bda-4814-aa82-e94b7ef74a0d None None] MFA Rules not processed for user `d88b351fcdad4f2ab1a42e2ac3ee0856`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:06.892128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-69ccb876-2bda-4814-aa82-e94b7ef74a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:06.900660 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 519/1028] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Jul 26 00:04:06 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:06.914650 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b61bbe-64d3-47de-8de0-35e9086c209b None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:06.914987 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b61bbe-64d3-47de-8de0-35e9086c209b None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:06.915259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b61bbe-64d3-47de-8de0-35e9086c209b None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:06.916574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 510/1029] 10.222.0.65 () {54 vars in 918 bytes} [Tue Jul 26 00:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:06.921440 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31356b-a793-4274-8c93-a6b09ae5a77a None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:06.921725 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31356b-a793-4274-8c93-a6b09ae5a77a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:06.921999 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31356b-a793-4274-8c93-a6b09ae5a77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:06.941753 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-1a31356b-a793-4274-8c93-a6b09ae5a77a None None] MFA Rules not processed for user `a513753b2f49408baf24402f1fa3c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:06.942968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-1a31356b-a793-4274-8c93-a6b09ae5a77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:06.952006 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 520/1030] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Jul 26 00:04:06 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:09.646378 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ba69c-08e0-4d67-a4c1-a8499e0dd700 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:09.646967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ba69c-08e0-4d67-a4c1-a8499e0dd700 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:09.646967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ba69c-08e0-4d67-a4c1-a8499e0dd700 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:09.648415 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 511/1031] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:09.653841 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0ed45-dcc4-4ce8-9d0f-62792a3a8d01 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:09.654269 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0ed45-dcc4-4ce8-9d0f-62792a3a8d01 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:09.654397 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0ed45-dcc4-4ce8-9d0f-62792a3a8d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:09.673942 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-8db0ed45-dcc4-4ce8-9d0f-62792a3a8d01 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:09.675167 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-8db0ed45-dcc4-4ce8-9d0f-62792a3a8d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:09.683706 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 521/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:04:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:09.728471 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ba69c-08e0-4d67-a4c1-a8499e0dd700 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:09.741972 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ba69c-08e0-4d67-a4c1-a8499e0dd700 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:09.746989 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3cbe1-e793-4346-9529-e9a836d76801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:09.747616 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3cbe1-e793-4346-9529-e9a836d76801 service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:09.747895 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3cbe1-e793-4346-9529-e9a836d76801 service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:09.748167 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3cbe1-e793-4346-9529-e9a836d76801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:09.756115 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3cbe1-e793-4346-9529-e9a836d76801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:09.757745 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3cbe1-e793-4346-9529-e9a836d76801 service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:09.767032 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 512/1033] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:10.714583 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa797f-f3e8-4c92-bb25-2483f7360a75 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:10.715212 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa797f-f3e8-4c92-bb25-2483f7360a75 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:10.715212 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa797f-f3e8-4c92-bb25-2483f7360a75 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:10.716474 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 522/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 00:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:10.721383 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5254028-18ee-4dfd-b477-03764d81c74d None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:10.721792 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5254028-18ee-4dfd-b477-03764d81c74d None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:10.721985 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5254028-18ee-4dfd-b477-03764d81c74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:10.741911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-b5254028-18ee-4dfd-b477-03764d81c74d None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:10.743338 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-b5254028-18ee-4dfd-b477-03764d81c74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:10.750967 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 513/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 00:04:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:10.935073 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa797f-f3e8-4c92-bb25-2483f7360a75 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:10.949719 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa797f-f3e8-4c92-bb25-2483f7360a75 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:10.954594 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27488add-5b1d-4e08-bc98-de49c07ecfb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:10.955231 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27488add-5b1d-4e08-bc98-de49c07ecfb0 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:10.955508 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27488add-5b1d-4e08-bc98-de49c07ecfb0 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:10.955786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27488add-5b1d-4e08-bc98-de49c07ecfb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:10.964961 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27488add-5b1d-4e08-bc98-de49c07ecfb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:10.966470 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27488add-5b1d-4e08-bc98-de49c07ecfb0 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:10.975790 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 523/1036] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:11.882445 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092cde6-f747-41a6-b70e-6e4b601208d2 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:11.883425 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092cde6-f747-41a6-b70e-6e4b601208d2 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:11.883425 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092cde6-f747-41a6-b70e-6e4b601208d2 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:11.884431 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 514/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 00:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:11.889336 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471a5c0-74fb-4ae3-96b1-edae7d659918 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:11.889770 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471a5c0-74fb-4ae3-96b1-edae7d659918 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:11.889880 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471a5c0-74fb-4ae3-96b1-edae7d659918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:11.909879 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-5471a5c0-74fb-4ae3-96b1-edae7d659918 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:11.911116 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-5471a5c0-74fb-4ae3-96b1-edae7d659918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:11.919462 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 524/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 00:04:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:12.077261 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092cde6-f747-41a6-b70e-6e4b601208d2 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:12.091066 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092cde6-f747-41a6-b70e-6e4b601208d2 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:12.095822 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fe28c-3eeb-4c0e-8f42-b1df472c3892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:12.096443 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fe28c-3eeb-4c0e-8f42-b1df472c3892 service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:12.096718 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fe28c-3eeb-4c0e-8f42-b1df472c3892 service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:12.096989 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fe28c-3eeb-4c0e-8f42-b1df472c3892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:12.105263 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fe28c-3eeb-4c0e-8f42-b1df472c3892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:12.106904 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fe28c-3eeb-4c0e-8f42-b1df472c3892 service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:12.116139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 515/1039] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:12.980330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76385d6d-0a3a-4bd5-b9dd-8353d66211ac None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:12.980874 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76385d6d-0a3a-4bd5-b9dd-8353d66211ac None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:12.980874 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76385d6d-0a3a-4bd5-b9dd-8353d66211ac None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:12.982265 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 525/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 00:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 00:04:12.987288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70edab-18e6-4eb1-89a3-da9a4317e7a5 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:12.987708 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70edab-18e6-4eb1-89a3-da9a4317e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:12.987842 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70edab-18e6-4eb1-89a3-da9a4317e7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:13.008139 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-5d70edab-18e6-4eb1-89a3-da9a4317e7a5 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:13.009339 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-5d70edab-18e6-4eb1-89a3-da9a4317e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:13.017092 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 516/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 00:04:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:13.174188 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76385d6d-0a3a-4bd5-b9dd-8353d66211ac None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:13.188241 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76385d6d-0a3a-4bd5-b9dd-8353d66211ac None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:13.193024 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad2dc3-167c-40b9-a4a9-66ce69bf92dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:13.193628 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad2dc3-167c-40b9-a4a9-66ce69bf92dc service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:13.193891 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad2dc3-167c-40b9-a4a9-66ce69bf92dc service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:13.194156 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad2dc3-167c-40b9-a4a9-66ce69bf92dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:13.202524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad2dc3-167c-40b9-a4a9-66ce69bf92dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:13.204200 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad2dc3-167c-40b9-a4a9-66ce69bf92dc service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:13.213820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 526/1042] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:14.092973 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74df97-4295-4a1b-85d9-63269acf8fa9 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:14.093524 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74df97-4295-4a1b-85d9-63269acf8fa9 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:14.093623 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74df97-4295-4a1b-85d9-63269acf8fa9 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:14.094990 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 517/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 00:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:14.099878 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74f73-ec96-4792-97c9-b9f3a6d3ae77 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:14.100293 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74f73-ec96-4792-97c9-b9f3a6d3ae77 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:14.100424 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74f73-ec96-4792-97c9-b9f3a6d3ae77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:14.119281 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-42c74f73-ec96-4792-97c9-b9f3a6d3ae77 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:14.120449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-42c74f73-ec96-4792-97c9-b9f3a6d3ae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:14.128013 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 527/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 00:04:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:14.283112 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74df97-4295-4a1b-85d9-63269acf8fa9 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:14.296209 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74df97-4295-4a1b-85d9-63269acf8fa9 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:14.301098 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825f486-846b-4dde-b388-5d069b9be0fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:14.301698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f486-846b-4dde-b388-5d069b9be0fc service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:14.301980 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f486-846b-4dde-b388-5d069b9be0fc service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:14.302254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825f486-846b-4dde-b388-5d069b9be0fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:14.311215 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f486-846b-4dde-b388-5d069b9be0fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:14.312797 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825f486-846b-4dde-b388-5d069b9be0fc service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:14.322557 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 518/1045] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:15.130868 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2bf90-1632-46e9-a1ca-836ca12a66a0 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:15.131393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2bf90-1632-46e9-a1ca-836ca12a66a0 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:15.131393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2bf90-1632-46e9-a1ca-836ca12a66a0 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:15.132777 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 528/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 00:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:15.137894 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9c3e5-3a17-40cc-95fa-e36c4b28ecf8 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:15.138302 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9c3e5-3a17-40cc-95fa-e36c4b28ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:15.138446 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9c3e5-3a17-40cc-95fa-e36c4b28ecf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:15.158122 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-74a9c3e5-3a17-40cc-95fa-e36c4b28ecf8 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:15.159337 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-74a9c3e5-3a17-40cc-95fa-e36c4b28ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:15.168207 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 519/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 00:04:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:15.330343 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2bf90-1632-46e9-a1ca-836ca12a66a0 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:15.344354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2bf90-1632-46e9-a1ca-836ca12a66a0 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:15.349271 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4686a5e-615c-4ef0-aa78-f16bccf599d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:15.349872 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4686a5e-615c-4ef0-aa78-f16bccf599d0 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:15.350145 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4686a5e-615c-4ef0-aa78-f16bccf599d0 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:15.350415 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4686a5e-615c-4ef0-aa78-f16bccf599d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:15.358465 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4686a5e-615c-4ef0-aa78-f16bccf599d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:15.360061 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4686a5e-615c-4ef0-aa78-f16bccf599d0 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:15.369280 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 529/1048] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:16.192680 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266074a4-50e5-4cf3-99e0-a87bef47011d None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:16.193226 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266074a4-50e5-4cf3-99e0-a87bef47011d None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:16.193226 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266074a4-50e5-4cf3-99e0-a87bef47011d None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:16.194597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 520/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 00:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:16.200152 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d368e2-56d4-4009-9f4a-9b810d11f317 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:16.200660 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d368e2-56d4-4009-9f4a-9b810d11f317 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:16.200759 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d368e2-56d4-4009-9f4a-9b810d11f317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:16.220130 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-b2d368e2-56d4-4009-9f4a-9b810d11f317 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:16.221300 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-b2d368e2-56d4-4009-9f4a-9b810d11f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:16.229027 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 530/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 00:04:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:16.384003 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266074a4-50e5-4cf3-99e0-a87bef47011d None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:16.397453 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266074a4-50e5-4cf3-99e0-a87bef47011d None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:16.403385 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda271f3-ec63-4660-85f4-132491a6602a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:16.403986 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda271f3-ec63-4660-85f4-132491a6602a service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:16.404269 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda271f3-ec63-4660-85f4-132491a6602a service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:16.404544 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda271f3-ec63-4660-85f4-132491a6602a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:16.412491 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda271f3-ec63-4660-85f4-132491a6602a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:16.414624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda271f3-ec63-4660-85f4-132491a6602a service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:16.423938 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 521/1051] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:17.239729 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82be5e-aa81-4a7e-a3e9-2c2d3e2d9c6d None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:17.240236 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82be5e-aa81-4a7e-a3e9-2c2d3e2d9c6d None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:17.240236 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82be5e-aa81-4a7e-a3e9-2c2d3e2d9c6d None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:17.241507 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 531/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 00:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:17.246875 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b439b-e754-4330-94d5-75c70e434854 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:17.247272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b439b-e754-4330-94d5-75c70e434854 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:17.247440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b439b-e754-4330-94d5-75c70e434854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:17.267427 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-450b439b-e754-4330-94d5-75c70e434854 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:17.268626 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-450b439b-e754-4330-94d5-75c70e434854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:17.276461 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 522/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 00:04:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:17.431994 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82be5e-aa81-4a7e-a3e9-2c2d3e2d9c6d None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:17.446313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82be5e-aa81-4a7e-a3e9-2c2d3e2d9c6d None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:17.451224 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7e897-5edc-4368-892d-7f2fab2c1da0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:17.451820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7e897-5edc-4368-892d-7f2fab2c1da0 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:17.452101 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7e897-5edc-4368-892d-7f2fab2c1da0 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:17.452375 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7e897-5edc-4368-892d-7f2fab2c1da0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:17.460308 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7e897-5edc-4368-892d-7f2fab2c1da0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:17.462185 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7e897-5edc-4368-892d-7f2fab2c1da0 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:17.471448 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 532/1054] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:18.342494 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a45cf-cb71-4bc2-8097-f0b8c05ef9d4 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:18.342989 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a45cf-cb71-4bc2-8097-f0b8c05ef9d4 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:18.343113 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a45cf-cb71-4bc2-8097-f0b8c05ef9d4 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:18.344465 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 523/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 00:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:18.349349 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac93b31-3079-4ceb-8f7b-24867802ccbc None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:18.349759 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac93b31-3079-4ceb-8f7b-24867802ccbc None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:18.349907 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac93b31-3079-4ceb-8f7b-24867802ccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:18.370685 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-9ac93b31-3079-4ceb-8f7b-24867802ccbc None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:18.371908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-9ac93b31-3079-4ceb-8f7b-24867802ccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:18.379792 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 533/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 00:04:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:18.533597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a45cf-cb71-4bc2-8097-f0b8c05ef9d4 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:18.547524 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a45cf-cb71-4bc2-8097-f0b8c05ef9d4 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:18.552461 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de9169-ac13-48a4-9f31-b49c1a7cdf2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:18.553088 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de9169-ac13-48a4-9f31-b49c1a7cdf2f service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:18.553369 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de9169-ac13-48a4-9f31-b49c1a7cdf2f service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:18.553644 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de9169-ac13-48a4-9f31-b49c1a7cdf2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:18.562444 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de9169-ac13-48a4-9f31-b49c1a7cdf2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:18.564111 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de9169-ac13-48a4-9f31-b49c1a7cdf2f service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:18.573220 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 524/1057] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:20.780542 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a136-bed0-4f4f-8c14-46c2f4408ce1 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:20.781066 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a136-bed0-4f4f-8c14-46c2f4408ce1 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:20.781066 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a136-bed0-4f4f-8c14-46c2f4408ce1 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:20.782350 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 534/1058] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:20.787850 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09509148-9d06-4c4d-aeee-e32307f01444 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:20.788273 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09509148-9d06-4c4d-aeee-e32307f01444 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:20.788411 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09509148-9d06-4c4d-aeee-e32307f01444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:20.808789 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-09509148-9d06-4c4d-aeee-e32307f01444 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:20.810256 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-09509148-9d06-4c4d-aeee-e32307f01444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:20.818423 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 525/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:04:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:20.858502 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6a136-bed0-4f4f-8c14-46c2f4408ce1 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:20.870037 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6a136-bed0-4f4f-8c14-46c2f4408ce1 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:20.873519 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7722220-ed61-4c67-adde-c4b337f8b5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:20.874113 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7722220-ed61-4c67-adde-c4b337f8b5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:20.874388 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7722220-ed61-4c67-adde-c4b337f8b5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:20.874802 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7722220-ed61-4c67-adde-c4b337f8b5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:20.883742 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7722220-ed61-4c67-adde-c4b337f8b5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:20.885521 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7722220-ed61-4c67-adde-c4b337f8b5b2 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:20.895768 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 535/1060] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:23.364159 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cb07a-c92b-4edd-b419-093da5d59e5a None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:23.364721 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cb07a-c92b-4edd-b419-093da5d59e5a None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:23.364721 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cb07a-c92b-4edd-b419-093da5d59e5a None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:23.366076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 526/1061] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:23.371774 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc433a-a1aa-4cd4-9f42-f4dfdaa5a439 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:23.372171 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc433a-a1aa-4cd4-9f42-f4dfdaa5a439 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:23.372356 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc433a-a1aa-4cd4-9f42-f4dfdaa5a439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:23.391748 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-1fdc433a-a1aa-4cd4-9f42-f4dfdaa5a439 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:23.392921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-1fdc433a-a1aa-4cd4-9f42-f4dfdaa5a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:23.400662 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 536/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:04:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:23.439629 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cb07a-c92b-4edd-b419-093da5d59e5a None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:23.451019 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cb07a-c92b-4edd-b419-093da5d59e5a None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:23.454456 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced06559-4377-4c87-b640-fb0fa0f941db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:23.455087 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced06559-4377-4c87-b640-fb0fa0f941db service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:23.455368 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced06559-4377-4c87-b640-fb0fa0f941db service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:23.455640 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced06559-4377-4c87-b640-fb0fa0f941db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:23.464802 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced06559-4377-4c87-b640-fb0fa0f941db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:23.466230 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced06559-4377-4c87-b640-fb0fa0f941db service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:23.475458 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 527/1063] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:26.013045 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89766a90-46a9-42c7-8772-7af3285ce1ab None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:26.013518 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89766a90-46a9-42c7-8772-7af3285ce1ab None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:26.013623 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89766a90-46a9-42c7-8772-7af3285ce1ab None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:26.014986 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 537/1064] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:26.020134 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b982d4-de91-45bd-900b-586109b88fa5 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:26.020573 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b982d4-de91-45bd-900b-586109b88fa5 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:26.020677 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b982d4-de91-45bd-900b-586109b88fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:26.040898 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-87b982d4-de91-45bd-900b-586109b88fa5 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:26.042078 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-87b982d4-de91-45bd-900b-586109b88fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:26.049813 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 528/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:04:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:26.089418 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89766a90-46a9-42c7-8772-7af3285ce1ab None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:26.099804 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89766a90-46a9-42c7-8772-7af3285ce1ab None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:26.104032 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866c490-84d6-4888-871b-1487d9973d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:26.104623 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866c490-84d6-4888-871b-1487d9973d50 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:26.104897 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866c490-84d6-4888-871b-1487d9973d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:26.105164 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866c490-84d6-4888-871b-1487d9973d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:26.113699 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866c490-84d6-4888-871b-1487d9973d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:26.115153 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866c490-84d6-4888-871b-1487d9973d50 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:26.124825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 538/1066] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:28.450490 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919d504-2f55-47ad-82a0-d4848d618d72 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:28.451083 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919d504-2f55-47ad-82a0-d4848d618d72 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:28.451083 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919d504-2f55-47ad-82a0-d4848d618d72 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:28.452437 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 529/1067] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:28.457783 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258f855-413c-423f-b49b-537e0cbbc12a None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:28.458242 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258f855-413c-423f-b49b-537e0cbbc12a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:28.458339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258f855-413c-423f-b49b-537e0cbbc12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:28.478030 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-b258f855-413c-423f-b49b-537e0cbbc12a None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:28.479254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-b258f855-413c-423f-b49b-537e0cbbc12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:28.486916 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 539/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:04:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:28.527629 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919d504-2f55-47ad-82a0-d4848d618d72 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:28.538221 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919d504-2f55-47ad-82a0-d4848d618d72 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:28.541805 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af95d-cd91-4b5f-9e56-5eaacb4b27c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:28.542401 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af95d-cd91-4b5f-9e56-5eaacb4b27c5 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:28.542678 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af95d-cd91-4b5f-9e56-5eaacb4b27c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:28.542991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af95d-cd91-4b5f-9e56-5eaacb4b27c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:28.551591 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941af95d-cd91-4b5f-9e56-5eaacb4b27c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:28.553044 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941af95d-cd91-4b5f-9e56-5eaacb4b27c5 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:28.563133 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 530/1069] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:30.835082 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56396f97-55f3-429c-9c77-6fbddf0f9653 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:30.835637 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56396f97-55f3-429c-9c77-6fbddf0f9653 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:30.835637 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56396f97-55f3-429c-9c77-6fbddf0f9653 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:30.836980 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 540/1070] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:30.842238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8deaaf-cefc-4b4f-bf15-10e5ef2ce9a7 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:30.842663 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8deaaf-cefc-4b4f-bf15-10e5ef2ce9a7 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:30.842827 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8deaaf-cefc-4b4f-bf15-10e5ef2ce9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:30.861921 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-bd8deaaf-cefc-4b4f-bf15-10e5ef2ce9a7 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:30.863143 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-bd8deaaf-cefc-4b4f-bf15-10e5ef2ce9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:30.871406 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 531/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:04:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:30.909524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56396f97-55f3-429c-9c77-6fbddf0f9653 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:30.920154 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56396f97-55f3-429c-9c77-6fbddf0f9653 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:30.923596 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e90784-70ea-4f87-ac78-8c42a85efa34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:30.924192 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e90784-70ea-4f87-ac78-8c42a85efa34 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:30.924471 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e90784-70ea-4f87-ac78-8c42a85efa34 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:30.924746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e90784-70ea-4f87-ac78-8c42a85efa34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:30.934497 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e90784-70ea-4f87-ac78-8c42a85efa34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:30.935945 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e90784-70ea-4f87-ac78-8c42a85efa34 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:30.945755 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 541/1072] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:33.210546 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fa8a3-0c77-428f-95f8-a2dbbf1f8c4a None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:33.211120 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fa8a3-0c77-428f-95f8-a2dbbf1f8c4a None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:33.211120 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fa8a3-0c77-428f-95f8-a2dbbf1f8c4a None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:33.212450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 532/1073] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:33.217658 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975ad19-3973-4856-886f-d5e65701116a None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:33.218094 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975ad19-3973-4856-886f-d5e65701116a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:33.218200 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975ad19-3973-4856-886f-d5e65701116a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:33.237506 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-9975ad19-3973-4856-886f-d5e65701116a None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:33.238692 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-9975ad19-3973-4856-886f-d5e65701116a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:33.246329 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 542/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:04:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:33.285146 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fa8a3-0c77-428f-95f8-a2dbbf1f8c4a None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:33.296308 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fa8a3-0c77-428f-95f8-a2dbbf1f8c4a None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:33.299789 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a2077-e236-4bfb-bd02-913f92e0ffa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:33.300387 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a2077-e236-4bfb-bd02-913f92e0ffa3 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:33.300665 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a2077-e236-4bfb-bd02-913f92e0ffa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:33.300938 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a2077-e236-4bfb-bd02-913f92e0ffa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:33.310242 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a2077-e236-4bfb-bd02-913f92e0ffa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:33.311698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a2077-e236-4bfb-bd02-913f92e0ffa3 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:33.321648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 533/1075] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:35.643343 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab5c7b-9ecc-4888-9389-a8d2ff7d8bcd None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:35.643937 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab5c7b-9ecc-4888-9389-a8d2ff7d8bcd None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:35.643937 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab5c7b-9ecc-4888-9389-a8d2ff7d8bcd None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:35.645221 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 543/1076] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:35.651576 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df959643-c6df-4867-b686-b32c94fdee62 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:35.651971 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df959643-c6df-4867-b686-b32c94fdee62 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:35.652130 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df959643-c6df-4867-b686-b32c94fdee62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:35.659616 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=70 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:04:35.672317 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-df959643-c6df-4867-b686-b32c94fdee62 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:35.673512 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-df959643-c6df-4867-b686-b32c94fdee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:35.681271 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 534/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:04:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:35.721752 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab5c7b-9ecc-4888-9389-a8d2ff7d8bcd None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:35.727260 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=73 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:04:35.733560 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab5c7b-9ecc-4888-9389-a8d2ff7d8bcd None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:35.737344 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f2efb-8d89-4876-9d18-dad730bfded1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:35.737938 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f2efb-8d89-4876-9d18-dad730bfded1 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:35.738213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f2efb-8d89-4876-9d18-dad730bfded1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:35.738506 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f2efb-8d89-4876-9d18-dad730bfded1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:35.747453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f2efb-8d89-4876-9d18-dad730bfded1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:35.748848 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f2efb-8d89-4876-9d18-dad730bfded1 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:35.758419 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 544/1078] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:38.034319 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13559d1-5ec2-4c29-a1d0-e4a517c7ed82 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:38.034885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13559d1-5ec2-4c29-a1d0-e4a517c7ed82 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:38.034885 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13559d1-5ec2-4c29-a1d0-e4a517c7ed82 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:38.036237 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 535/1079] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:38.042065 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d4e72-619f-4829-99fd-e8dbcd7f4794 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:38.042549 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d4e72-619f-4829-99fd-e8dbcd7f4794 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:38.042654 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d4e72-619f-4829-99fd-e8dbcd7f4794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:38.062378 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-377d4e72-619f-4829-99fd-e8dbcd7f4794 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:38.063650 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-377d4e72-619f-4829-99fd-e8dbcd7f4794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:38.074063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 545/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:04:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:38.112226 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13559d1-5ec2-4c29-a1d0-e4a517c7ed82 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:38.123456 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13559d1-5ec2-4c29-a1d0-e4a517c7ed82 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:38.126921 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf922533-f8ba-402e-872d-24cea2d1e553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:38.127522 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf922533-f8ba-402e-872d-24cea2d1e553 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:38.127801 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf922533-f8ba-402e-872d-24cea2d1e553 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:38.128073 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf922533-f8ba-402e-872d-24cea2d1e553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:38.136922 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf922533-f8ba-402e-872d-24cea2d1e553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:38.138372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf922533-f8ba-402e-872d-24cea2d1e553 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:38.148158 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 536/1081] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:40.374643 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560835-cc23-49f8-8928-a2e25a102f43 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:40.375225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560835-cc23-49f8-8928-a2e25a102f43 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:40.375225 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560835-cc23-49f8-8928-a2e25a102f43 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:40.376563 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 546/1082] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:04:40.381864 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f837a-1ecc-43e1-8a21-bc7a71a29b7a None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:40.382431 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f837a-1ecc-43e1-8a21-bc7a71a29b7a None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:40.382527 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f837a-1ecc-43e1-8a21-bc7a71a29b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:40.401941 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-2e6f837a-1ecc-43e1-8a21-bc7a71a29b7a None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:40.403178 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-2e6f837a-1ecc-43e1-8a21-bc7a71a29b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:40.410923 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 537/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:04:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:40.449307 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e560835-cc23-49f8-8928-a2e25a102f43 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:40.460340 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e560835-cc23-49f8-8928-a2e25a102f43 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:40.464174 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05303e7-069b-404e-9217-847f7a5bf000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:40.464773 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05303e7-069b-404e-9217-847f7a5bf000 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:40.465050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05303e7-069b-404e-9217-847f7a5bf000 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:40.465320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05303e7-069b-404e-9217-847f7a5bf000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:40.474186 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05303e7-069b-404e-9217-847f7a5bf000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:40.476335 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05303e7-069b-404e-9217-847f7a5bf000 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:40.485383 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 547/1084] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:42.700977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b20d1-265c-4af2-bcdc-af61b01509e8 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:42.701540 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b20d1-265c-4af2-bcdc-af61b01509e8 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:42.701540 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b20d1-265c-4af2-bcdc-af61b01509e8 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:42.702932 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 538/1085] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 00:04:42.708012 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cc422-d071-4d76-87dc-6c0073d43715 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:42.708396 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cc422-d071-4d76-87dc-6c0073d43715 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:42.708558 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cc422-d071-4d76-87dc-6c0073d43715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:42.728196 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-6c7cc422-d071-4d76-87dc-6c0073d43715 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:04:42.729363 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-6c7cc422-d071-4d76-87dc-6c0073d43715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:04:42.741274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 548/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:04:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:04:42.784420 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b20d1-265c-4af2-bcdc-af61b01509e8 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:04:42.795689 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b20d1-265c-4af2-bcdc-af61b01509e8 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:04:42.799128 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e3eff-e4f2-49d2-ade7-d38fd490f5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:04:42.799731 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e3eff-e4f2-49d2-ade7-d38fd490f5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:04:42.800009 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e3eff-e4f2-49d2-ade7-d38fd490f5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:04:42.800282 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e3eff-e4f2-49d2-ade7-d38fd490f5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:04:42.809440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e3eff-e4f2-49d2-ade7-d38fd490f5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:04:42.810881 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e3eff-e4f2-49d2-ade7-d38fd490f5b4 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:04:42.820204 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 539/1087] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:04:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:04:52.722884 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=17 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:04:52.816009 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=17 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:05:06.406624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8caec-1c66-4ce9-888e-b7937f2b97e6 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:06.407217 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8caec-1c66-4ce9-888e-b7937f2b97e6 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:06.407217 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8caec-1c66-4ce9-888e-b7937f2b97e6 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:06.408540 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 549/1088] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:05:06.414344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83ba38-c094-4c18-8c11-6194a3bb11b7 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:06.414790 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83ba38-c094-4c18-8c11-6194a3bb11b7 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:06.414979 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83ba38-c094-4c18-8c11-6194a3bb11b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:06.435290 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-1d83ba38-c094-4c18-8c11-6194a3bb11b7 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:05:06.436518 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-1d83ba38-c094-4c18-8c11-6194a3bb11b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:05:06.444512 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 540/1089] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:05:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:05:06.493764 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5144-b706-418d-a2a1-db462eb1e562 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:06.494093 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5144-b706-418d-a2a1-db462eb1e562 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:06.494320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5144-b706-418d-a2a1-db462eb1e562 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:06.495681 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 550/1090] 10.222.0.65 () {54 vars in 966 bytes} [Tue Jul 26 00:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:05:06.501010 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107c7bb-abb8-44fd-b594-dcab8ab1aa5e None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:06.501258 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107c7bb-abb8-44fd-b594-dcab8ab1aa5e None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:06.501530 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107c7bb-abb8-44fd-b594-dcab8ab1aa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:06.522436 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-2107c7bb-abb8-44fd-b594-dcab8ab1aa5e None None] MFA Rules not processed for user `cbc09289c7e645b189776f109b78968e`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:05:06.523677 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-2107c7bb-abb8-44fd-b594-dcab8ab1aa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:05:06.530063 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 541/1091] 10.222.0.65 () {58 vars in 1063 bytes} [Tue Jul 26 00:05:06 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:05:06.538307 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5144-b706-418d-a2a1-db462eb1e562 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:05:06.548783 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5144-b706-418d-a2a1-db462eb1e562 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:05:06.552255 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af42b37-cbe4-43a7-9a0b-ae18a1e85880 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc09289c7e645b189776f109b78968e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:05:06.553782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af42b37-cbe4-43a7-9a0b-ae18a1e85880 service glance] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:06.554101 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af42b37-cbe4-43a7-9a0b-ae18a1e85880 service glance] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:06.554380 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af42b37-cbe4-43a7-9a0b-ae18a1e85880 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:06.563341 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af42b37-cbe4-43a7-9a0b-ae18a1e85880 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:05:06.564760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af42b37-cbe4-43a7-9a0b-ae18a1e85880 service glance] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:05:06.574063 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 551/1092] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:05:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:05:08.901320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f58d2-f7ed-48ca-8bf7-4808f704b63c None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:08.901968 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f58d2-f7ed-48ca-8bf7-4808f704b63c None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:08.901968 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f58d2-f7ed-48ca-8bf7-4808f704b63c None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:08.903236 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 542/1093] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:05:08.908337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ea65-8e9a-4819-b279-19482a082915 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:08.908739 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ea65-8e9a-4819-b279-19482a082915 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:08.908929 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ea65-8e9a-4819-b279-19482a082915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:08.929418 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-8933ea65-8e9a-4819-b279-19482a082915 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:05:08.930615 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-8933ea65-8e9a-4819-b279-19482a082915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:05:08.938620 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 552/1094] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:05:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:05:08.962839 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f58d2-f7ed-48ca-8bf7-4808f704b63c None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:05:08.975977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f58d2-f7ed-48ca-8bf7-4808f704b63c None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:05:08.980460 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e64ac-c67b-4f6a-b5e4-c5ea57c482f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:05:08.981062 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e64ac-c67b-4f6a-b5e4-c5ea57c482f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:08.981339 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e64ac-c67b-4f6a-b5e4-c5ea57c482f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:08.981610 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e64ac-c67b-4f6a-b5e4-c5ea57c482f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:08.982297 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e64ac-c67b-4f6a-b5e4-c5ea57c482f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:05:08.984138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: WARNING py.warnings [None req-bf3e64ac-c67b-4f6a-b5e4-c5ea57c482f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:05:08.984138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: warnings.warn(msg) Jul 26 00:05:08.984138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: Jul 26 00:05:08.985283 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e64ac-c67b-4f6a-b5e4-c5ea57c482f0 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:05:09.003692 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 543/1095] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Jul 26 00:05:08 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 00:05:11.231339 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830baa7b-292f-4dcd-8d79-4ecbaa1bd55f None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:11.231898 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830baa7b-292f-4dcd-8d79-4ecbaa1bd55f None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:11.231898 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830baa7b-292f-4dcd-8d79-4ecbaa1bd55f None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:11.233237 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 553/1096] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:05:11.238697 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67eb61-0fa4-4fd6-9957-154df29cd36c None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:11.239145 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67eb61-0fa4-4fd6-9957-154df29cd36c None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:11.239261 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67eb61-0fa4-4fd6-9957-154df29cd36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:11.258093 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-0c67eb61-0fa4-4fd6-9957-154df29cd36c None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:05:11.259327 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-0c67eb61-0fa4-4fd6-9957-154df29cd36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:05:11.267039 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 544/1097] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:05:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:05:11.311760 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830baa7b-292f-4dcd-8d79-4ecbaa1bd55f None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:05:11.325040 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830baa7b-292f-4dcd-8d79-4ecbaa1bd55f None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:05:11.329963 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e557bbd-3561-4cdc-85ce-1f76866e1449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:05:11.330567 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e557bbd-3561-4cdc-85ce-1f76866e1449 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:11.330906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e557bbd-3561-4cdc-85ce-1f76866e1449 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:11.331185 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e557bbd-3561-4cdc-85ce-1f76866e1449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:11.339975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e557bbd-3561-4cdc-85ce-1f76866e1449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:05:11.341544 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e557bbd-3561-4cdc-85ce-1f76866e1449 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:05:11.351741 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 554/1098] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:05:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:05:13.805414 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101f9c2-18ed-4370-b91e-ef2df391192b None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:13.805961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101f9c2-18ed-4370-b91e-ef2df391192b None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:13.805961 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101f9c2-18ed-4370-b91e-ef2df391192b None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:13.807338 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 545/1099] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:05:13.812880 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa16c6-0b1e-4fe1-9c22-bfc961e7f3b6 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:13.813316 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa16c6-0b1e-4fe1-9c22-bfc961e7f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:13.813420 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa16c6-0b1e-4fe1-9c22-bfc961e7f3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:13.832615 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-1cfa16c6-0b1e-4fe1-9c22-bfc961e7f3b6 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:05:13.833909 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-1cfa16c6-0b1e-4fe1-9c22-bfc961e7f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:05:13.841569 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 555/1100] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:05:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:05:13.878778 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101f9c2-18ed-4370-b91e-ef2df391192b None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:05:13.889624 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101f9c2-18ed-4370-b91e-ef2df391192b None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:05:13.893389 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb94c2d-933d-4770-9049-fac105d87676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:05:13.893991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb94c2d-933d-4770-9049-fac105d87676 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:13.894272 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb94c2d-933d-4770-9049-fac105d87676 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:13.894552 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb94c2d-933d-4770-9049-fac105d87676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:13.903579 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb94c2d-933d-4770-9049-fac105d87676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:05:13.905048 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb94c2d-933d-4770-9049-fac105d87676 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:05:13.915015 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 546/1101] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:05:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:05:16.194678 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4952f-2066-4d9c-bc9a-fb3b51138c65 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:16.195248 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4952f-2066-4d9c-bc9a-fb3b51138c65 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:16.195248 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4952f-2066-4d9c-bc9a-fb3b51138c65 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:16.196633 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 556/1102] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:05:16.201741 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343967cf-b7f9-455e-865b-1a902a13c269 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:16.202116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343967cf-b7f9-455e-865b-1a902a13c269 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:16.202308 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343967cf-b7f9-455e-865b-1a902a13c269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:16.221535 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-343967cf-b7f9-455e-865b-1a902a13c269 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:05:16.222756 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-343967cf-b7f9-455e-865b-1a902a13c269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:05:16.230547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 547/1103] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:05:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:05:16.268884 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4952f-2066-4d9c-bc9a-fb3b51138c65 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:05:16.280137 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4952f-2066-4d9c-bc9a-fb3b51138c65 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:05:16.283649 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255648f-a7b8-47e6-b647-106d4444cbcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:05:16.284252 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255648f-a7b8-47e6-b647-106d4444cbcb service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:16.284531 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255648f-a7b8-47e6-b647-106d4444cbcb service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:16.284802 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255648f-a7b8-47e6-b647-106d4444cbcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:16.293528 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255648f-a7b8-47e6-b647-106d4444cbcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:05:16.294970 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255648f-a7b8-47e6-b647-106d4444cbcb service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:05:16.304209 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 557/1104] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:05:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:05:18.628676 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e1935-03f7-452a-9d34-e652b0a186da None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:18.629262 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e1935-03f7-452a-9d34-e652b0a186da None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:18.629262 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e1935-03f7-452a-9d34-e652b0a186da None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:18.631133 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 548/1105] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:05:18.636385 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e01623-a407-4d46-964f-aa5ba1cb987d None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:18.636812 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e01623-a407-4d46-964f-aa5ba1cb987d None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:18.636939 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e01623-a407-4d46-964f-aa5ba1cb987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:18.656252 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-e3e01623-a407-4d46-964f-aa5ba1cb987d None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:05:18.657429 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-e3e01623-a407-4d46-964f-aa5ba1cb987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:05:18.665414 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 558/1106] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:05:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:05:18.706969 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e1935-03f7-452a-9d34-e652b0a186da None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:05:18.718243 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e1935-03f7-452a-9d34-e652b0a186da None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:05:18.721827 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839216e-f8c3-483e-bdc8-aa83351e468b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:05:18.722440 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839216e-f8c3-483e-bdc8-aa83351e468b service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:18.722736 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839216e-f8c3-483e-bdc8-aa83351e468b service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:18.723018 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839216e-f8c3-483e-bdc8-aa83351e468b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:18.731904 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839216e-f8c3-483e-bdc8-aa83351e468b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:05:18.733364 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839216e-f8c3-483e-bdc8-aa83351e468b service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:05:18.743472 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 549/1107] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:05:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:05:21.173658 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13095b23-cf77-4657-a790-0dc093d429ed None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:21.174210 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13095b23-cf77-4657-a790-0dc093d429ed None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:21.174210 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13095b23-cf77-4657-a790-0dc093d429ed None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:21.175598 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 559/1108] 10.222.0.65 () {54 vars in 926 bytes} [Tue Jul 26 00:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:05:21.181582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ca7e5-1124-4e02-a9d3-4c73cf5ee67b None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:21.182029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ca7e5-1124-4e02-a9d3-4c73cf5ee67b None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:21.182296 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ca7e5-1124-4e02-a9d3-4c73cf5ee67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:21.206194 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-125ca7e5-1124-4e02-a9d3-4c73cf5ee67b None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:05:21.207431 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-125ca7e5-1124-4e02-a9d3-4c73cf5ee67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:05:21.215780 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 550/1109] 10.222.0.65 () {58 vars in 1023 bytes} [Tue Jul 26 00:05:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:05:21.262504 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13095b23-cf77-4657-a790-0dc093d429ed None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:05:21.274987 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13095b23-cf77-4657-a790-0dc093d429ed None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:05:21.278618 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64987ac6-ffc6-49b3-bed5-ea9a924146d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:05:21.279258 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64987ac6-ffc6-49b3-bed5-ea9a924146d9 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:05:21.279539 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64987ac6-ffc6-49b3-bed5-ea9a924146d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:05:21.279815 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64987ac6-ffc6-49b3-bed5-ea9a924146d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:05:21.291465 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64987ac6-ffc6-49b3-bed5-ea9a924146d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:05:21.293261 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64987ac6-ffc6-49b3-bed5-ea9a924146d9 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:05:21.306640 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 560/1110] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:05:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:05:31.200692 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=33 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:05:31.301712 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=33 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:06:56.432584 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0fe60-6395-4821-8e83-688cf8de98a8 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:56.433185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0fe60-6395-4821-8e83-688cf8de98a8 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:56.433185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0fe60-6395-4821-8e83-688cf8de98a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:56.452535 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-64d0fe60-6395-4821-8e83-688cf8de98a8 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:06:56.453732 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-64d0fe60-6395-4821-8e83-688cf8de98a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:06:56.462197 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 551/1111] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:06:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:06:56.470584 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10360c00-1e8e-4c71-a147-ac52efe22d12 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:56.471188 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10360c00-1e8e-4c71-a147-ac52efe22d12 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:56.471188 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10360c00-1e8e-4c71-a147-ac52efe22d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:56.490831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-10360c00-1e8e-4c71-a147-ac52efe22d12 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:06:56.492023 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-10360c00-1e8e-4c71-a147-ac52efe22d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:06:56.500175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 561/1112] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:06:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:06:56.504721 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0fe60-6395-4821-8e83-688cf8de98a8 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:06:56.514491 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0fe60-6395-4821-8e83-688cf8de98a8 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:06:56.520544 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e488e-e656-4f6b-881a-531ab0d5c34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:06:56.521390 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e488e-e656-4f6b-881a-531ab0d5c34f admin admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:56.522036 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e488e-e656-4f6b-881a-531ab0d5c34f admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:56.522036 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e488e-e656-4f6b-881a-531ab0d5c34f admin admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:56.522636 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e488e-e656-4f6b-881a-531ab0d5c34f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:06:56.522981 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e488e-e656-4f6b-881a-531ab0d5c34f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:06:56.524010 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: WARNING py.warnings [None req-7a8e488e-e656-4f6b-881a-531ab0d5c34f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:06:56.524010 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: warnings.warn(msg) Jul 26 00:06:56.524010 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: Jul 26 00:06:56.524964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e488e-e656-4f6b-881a-531ab0d5c34f admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:06:56.538294 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 552/1113] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Jul 26 00:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:06:56.546695 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10360c00-1e8e-4c71-a147-ac52efe22d12 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:06:56.555991 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10360c00-1e8e-4c71-a147-ac52efe22d12 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:06:56.560984 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75721f-e2fe-4f19-ad79-378be10bbb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:06:56.561594 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75721f-e2fe-4f19-ad79-378be10bbb09 admin admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:56.561875 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75721f-e2fe-4f19-ad79-378be10bbb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:56.562148 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75721f-e2fe-4f19-ad79-378be10bbb09 admin admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:56.562855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75721f-e2fe-4f19-ad79-378be10bbb09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:06:56.564614 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: WARNING py.warnings [None req-eb75721f-e2fe-4f19-ad79-378be10bbb09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:06:56.564614 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: warnings.warn(msg) Jul 26 00:06:56.564614 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: Jul 26 00:06:56.566519 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75721f-e2fe-4f19-ad79-378be10bbb09 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:06:56.593648 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 562/1114] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Jul 26 00:06:56 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 00:06:56.598042 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e488e-e656-4f6b-881a-531ab0d5c34f admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:06:56.607891 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e488e-e656-4f6b-881a-531ab0d5c34f admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:06:56.667254 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03538ad-f08b-4a92-9edf-a17eaf6f58f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:06:56.667861 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03538ad-f08b-4a92-9edf-a17eaf6f58f1 admin admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:56.668141 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03538ad-f08b-4a92-9edf-a17eaf6f58f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:56.668417 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03538ad-f08b-4a92-9edf-a17eaf6f58f1 admin admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:56.669071 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03538ad-f08b-4a92-9edf-a17eaf6f58f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:06:56.670079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: WARNING py.warnings [None req-e03538ad-f08b-4a92-9edf-a17eaf6f58f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:06:56.670079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: warnings.warn(msg) Jul 26 00:06:56.670079 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: Jul 26 00:06:56.671307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03538ad-f08b-4a92-9edf-a17eaf6f58f1 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:06:56.693102 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 553/1115] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Jul 26 00:06:56 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 00:06:56.697577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75721f-e2fe-4f19-ad79-378be10bbb09 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:06:56.708549 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75721f-e2fe-4f19-ad79-378be10bbb09 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:06:56.713239 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83592115-d001-4cd9-8330-68fb1f31432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:06:56.713851 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83592115-d001-4cd9-8330-68fb1f31432f admin admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:56.714132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83592115-d001-4cd9-8330-68fb1f31432f admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:56.714409 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83592115-d001-4cd9-8330-68fb1f31432f admin admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:56.715130 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83592115-d001-4cd9-8330-68fb1f31432f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:06:56.716131 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: WARNING py.warnings [None req-83592115-d001-4cd9-8330-68fb1f31432f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:06:56.716131 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: warnings.warn(msg) Jul 26 00:06:56.716131 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: Jul 26 00:06:56.717025 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83592115-d001-4cd9-8330-68fb1f31432f admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:06:56.729570 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 563/1116] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Jul 26 00:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 00:06:56.733421 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03538ad-f08b-4a92-9edf-a17eaf6f58f1 admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:06:56.743276 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03538ad-f08b-4a92-9edf-a17eaf6f58f1 admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:06:56.747852 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d042-1002-4bc7-b47c-840db6219f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:06:56.748511 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d042-1002-4bc7-b47c-840db6219f2a admin admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:56.748797 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d042-1002-4bc7-b47c-840db6219f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:56.749075 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d042-1002-4bc7-b47c-840db6219f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:56.749763 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d042-1002-4bc7-b47c-840db6219f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:06:56.750810 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: WARNING py.warnings [None req-5842d042-1002-4bc7-b47c-840db6219f2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:06:56.750810 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: warnings.warn(msg) Jul 26 00:06:56.750810 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: Jul 26 00:06:56.751700 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d042-1002-4bc7-b47c-840db6219f2a admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:06:56.766939 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 554/1117] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Jul 26 00:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 00:06:56.771907 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83592115-d001-4cd9-8330-68fb1f31432f admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:06:56.781547 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83592115-d001-4cd9-8330-68fb1f31432f admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:06:56.786412 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cc134-9612-4ca1-90e1-d38b062c5828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:06:56.787164 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cc134-9612-4ca1-90e1-d38b062c5828 admin admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:56.787448 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cc134-9612-4ca1-90e1-d38b062c5828 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:56.787725 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cc134-9612-4ca1-90e1-d38b062c5828 admin admin] PATH_INFO: `/v3/projects/2d03ed4bffba4bfb998ff6a04dd890c6/users/5f8533aa1a0e400b990f712cfd2978e3/roles/5717836a50094587b879206794e7156a` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:56.802212 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cc134-9612-4ca1-90e1-d38b062c5828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d03ed4bffba4bfb998ff6a04dd890c6, user_id=5f8533aa1a0e400b990f712cfd2978e3, role_id=5717836a50094587b879206794e7156a)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:06:56.803267 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: WARNING py.warnings [None req-f24cc134-9612-4ca1-90e1-d38b062c5828 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:06:56.803267 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: warnings.warn(msg) Jul 26 00:06:56.803267 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: Jul 26 00:06:56.805186 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cc134-9612-4ca1-90e1-d38b062c5828 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:06:56.819822 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 564/1118] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Jul 26 00:06:56 2022] PUT /identity/v3/projects/2d03ed4bffba4bfb998ff6a04dd890c6/users/5f8533aa1a0e400b990f712cfd2978e3/roles/5717836a50094587b879206794e7156a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:06:56.832365 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c424d20-3a35-4e45-849e-efd2a4ac4927 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:56.832655 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c424d20-3a35-4e45-849e-efd2a4ac4927 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:56.832933 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c424d20-3a35-4e45-849e-efd2a4ac4927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:56.860008 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-9c424d20-3a35-4e45-849e-efd2a4ac4927 None None] MFA Rules not processed for user `5f8533aa1a0e400b990f712cfd2978e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:06:56.861392 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-9c424d20-3a35-4e45-849e-efd2a4ac4927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:06:56.923489 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 555/1119] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:06:56 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:06:56.937408 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6427f-3868-4400-83cc-f453e88039a3 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:56.937700 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6427f-3868-4400-83cc-f453e88039a3 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:56.937977 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6427f-3868-4400-83cc-f453e88039a3 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:56.939346 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 565/1120] 10.222.0.65 () {54 vars in 964 bytes} [Tue Jul 26 00:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:06:56.944709 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16287a-8f0a-4ed2-a102-c994b752f38a None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:56.944997 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16287a-8f0a-4ed2-a102-c994b752f38a None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:56.945271 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16287a-8f0a-4ed2-a102-c994b752f38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:56.964659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-db16287a-8f0a-4ed2-a102-c994b752f38a None None] MFA Rules not processed for user `5f8a981708a34de5be7cda18eb8bb1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:06:56.965831 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-db16287a-8f0a-4ed2-a102-c994b752f38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:06:57.009920 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:06:57.018541 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 556/1121] 10.222.0.65 () {58 vars in 1061 bytes} [Tue Jul 26 00:06:56 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:06:57.026320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6427f-3868-4400-83cc-f453e88039a3 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:06:57.036675 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6427f-3868-4400-83cc-f453e88039a3 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:06:57.040070 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5da65-fc5b-45fe-a926-ec811283bc08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8a981708a34de5be7cda18eb8bb1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:06:57.040656 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5da65-fc5b-45fe-a926-ec811283bc08 service cinder] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:57.040932 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5da65-fc5b-45fe-a926-ec811283bc08 service cinder] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:57.041202 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5da65-fc5b-45fe-a926-ec811283bc08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:57.049186 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5da65-fc5b-45fe-a926-ec811283bc08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:06:57.051288 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5da65-fc5b-45fe-a926-ec811283bc08 service cinder] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:06:57.059939 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 566/1122] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:06:57 2022] GET /identity/v3/auth/tokens => generated 2802 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:06:57.098127 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf4ab-279f-4f30-b6e4-76ec25881d3b None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:57.098418 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf4ab-279f-4f30-b6e4-76ec25881d3b None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:57.098699 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf4ab-279f-4f30-b6e4-76ec25881d3b None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:57.099999 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 557/1123] 10.222.0.65 () {52 vars in 830 bytes} [Tue Jul 26 00:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 00:06:57.103541 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5da65-fc5b-45fe-a926-ec811283bc08 service cinder] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:06:57.165105 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5da65-fc5b-45fe-a926-ec811283bc08 service cinder] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:06:57.169631 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:06:57.170259 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:57.170534 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:57.170842 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] PATH_INFO: `/v3/users/5f8533aa1a0e400b990f712cfd2978e3` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:57.171995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f8533aa1a0e400b990f712cfd2978e3)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:06:57.172995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: WARNING py.warnings [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:06:57.172995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: warnings.warn(msg) Jul 26 00:06:57.172995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: Jul 26 00:06:57.174180 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:06:57.238438 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f8533aa1a0e400b990f712cfd2978e3'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:06:57.239099 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f8533aa1a0e400b990f712cfd2978e3'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:06:57.257569 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f8533aa1a0e400b990f712cfd2978e3'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:06:57.267721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f8533aa1a0e400b990f712cfd2978e3'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:06:57.279953 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f8533aa1a0e400b990f712cfd2978e3'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:06:57.286370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 567/1124] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Jul 26 00:06:57 2022] DELETE /identity/v3/users/5f8533aa1a0e400b990f712cfd2978e3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:06:57.290795 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab854f-76cc-4668-9dc3-3ed20981c84b None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:57.291070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab854f-76cc-4668-9dc3-3ed20981c84b None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:57.291345 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab854f-76cc-4668-9dc3-3ed20981c84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:57.311179 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-6cab854f-76cc-4668-9dc3-3ed20981c84b None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:06:57.312391 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-6cab854f-76cc-4668-9dc3-3ed20981c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:06:57.371828 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 558/1125] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:06:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:06:57.381260 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:06:57.382751 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:06:57.388141 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:06:57.446260 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e38f63-bf5a-493b-b16d-ecdf46abbfc1 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:06:57.449858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21393e-49e4-4083-bd6e-11558c47dc5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:06:57.450474 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21393e-49e4-4083-bd6e-11558c47dc5d service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:57.450778 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21393e-49e4-4083-bd6e-11558c47dc5d service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:57.451052 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21393e-49e4-4083-bd6e-11558c47dc5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:57.460378 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21393e-49e4-4083-bd6e-11558c47dc5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:06:57.461820 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21393e-49e4-4083-bd6e-11558c47dc5d service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:06:57.470998 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 568/1126] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:06:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:06:57.792271 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab854f-76cc-4668-9dc3-3ed20981c84b None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:06:57.793908 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-6cab854f-76cc-4668-9dc3-3ed20981c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:06:57.807327 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab854f-76cc-4668-9dc3-3ed20981c84b None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:06:57.813205 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:06:57.813868 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:06:57.814153 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:06:57.815110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] PATH_INFO: `/v3/projects/2d03ed4bffba4bfb998ff6a04dd890c6` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:06:57.819489 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d03ed4bffba4bfb998ff6a04dd890c6)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:06:57.820562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: WARNING py.warnings [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:06:57.820562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: warnings.warn(msg) Jul 26 00:06:57.820562 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: Jul 26 00:06:57.821766 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:06:57.881873 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d03ed4bffba4bfb998ff6a04dd890c6', 'request_id': 'req-42736981-9e49-4260-9bda-62d22f611955'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:06:57.887696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d03ed4bffba4bfb998ff6a04dd890c6', 'request_id': 'req-42736981-9e49-4260-9bda-62d22f611955'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:06:57.896910 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d03ed4bffba4bfb998ff6a04dd890c6', 'request_id': 'req-42736981-9e49-4260-9bda-62d22f611955'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:06:57.915853 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] The token cache is being invalidate because project 2d03ed4bffba4bfb998ff6a04dd890c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 00:06:57.916141 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:06:57.916772 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-42736981-9e49-4260-9bda-62d22f611955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:06:57.918372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 559/1127] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Jul 26 00:06:57 2022] DELETE /identity/v3/projects/2d03ed4bffba4bfb998ff6a04dd890c6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:07:07.466969 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=25 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:07:07.912984 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:08:17.115509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb1a9-3d13-49db-9907-4d9aba78fa73 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:17.116101 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb1a9-3d13-49db-9907-4d9aba78fa73 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:17.116101 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb1a9-3d13-49db-9907-4d9aba78fa73 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:17.117391 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 569/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 00:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:08:17.122288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeefab2-e84a-432b-9363-aa90b3fe65aa None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:17.122694 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeefab2-e84a-432b-9363-aa90b3fe65aa None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:17.122893 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeefab2-e84a-432b-9363-aa90b3fe65aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:17.196551 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-caeefab2-e84a-432b-9363-aa90b3fe65aa None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:08:17.197752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-caeefab2-e84a-432b-9363-aa90b3fe65aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:17.422813 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 560/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 00:08:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:08:17.584646 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb1a9-3d13-49db-9907-4d9aba78fa73 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:08:17.586314 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-e3bbb1a9-3d13-49db-9907-4d9aba78fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:17.672090 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb1a9-3d13-49db-9907-4d9aba78fa73 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:08:17.677683 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e25f8f-9e35-495a-8694-c696c2ed8df3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:08:17.678230 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e25f8f-9e35-495a-8694-c696c2ed8df3 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:17.678506 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e25f8f-9e35-495a-8694-c696c2ed8df3 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:17.678805 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e25f8f-9e35-495a-8694-c696c2ed8df3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:17.686979 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e25f8f-9e35-495a-8694-c696c2ed8df3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:08:17.688557 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e25f8f-9e35-495a-8694-c696c2ed8df3 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:08:17.697833 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 570/1130] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:08:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:08:18.538964 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ca008-e604-433b-8084-c6ab2731c9fc None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:18.539551 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ca008-e604-433b-8084-c6ab2731c9fc None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:18.539551 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ca008-e604-433b-8084-c6ab2731c9fc None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:18.540882 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 561/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 00:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:08:18.545722 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d4c44-b307-4152-80ae-074c3e776419 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:18.546178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d4c44-b307-4152-80ae-074c3e776419 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:18.546282 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d4c44-b307-4152-80ae-074c3e776419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:18.566181 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-004d4c44-b307-4152-80ae-074c3e776419 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:08:18.567389 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-004d4c44-b307-4152-80ae-074c3e776419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:18.574941 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 571/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 00:08:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:08:18.731033 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ca008-e604-433b-8084-c6ab2731c9fc None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:08:18.745031 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ca008-e604-433b-8084-c6ab2731c9fc None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:08:18.749985 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63523ed1-a347-4e80-9d27-7f865d0f6c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:08:18.750591 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63523ed1-a347-4e80-9d27-7f865d0f6c54 service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:18.750911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63523ed1-a347-4e80-9d27-7f865d0f6c54 service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:18.751191 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63523ed1-a347-4e80-9d27-7f865d0f6c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:18.760938 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63523ed1-a347-4e80-9d27-7f865d0f6c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:08:18.762533 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63523ed1-a347-4e80-9d27-7f865d0f6c54 service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:08:18.772406 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 562/1133] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:08:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:08:23.255878 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b32c0-7113-4f9e-ba8f-2c41a055118e None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:23.256418 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b32c0-7113-4f9e-ba8f-2c41a055118e None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:23.256418 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b32c0-7113-4f9e-ba8f-2c41a055118e None None] PATH_INFO: `/v3` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:23.257653 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 572/1134] 10.222.0.17 () {54 vars in 925 bytes} [Tue Jul 26 00:08:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 00:08:23.263844 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2027f-6049-4890-a90a-6e636f2d6cc5 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:23.264262 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2027f-6049-4890-a90a-6e636f2d6cc5 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:23.264371 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2027f-6049-4890-a90a-6e636f2d6cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:23.298116 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-55a2027f-6049-4890-a90a-6e636f2d6cc5 None None] MFA Rules not processed for user `d88b351fcdad4f2ab1a42e2ac3ee0856`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:08:23.299605 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-55a2027f-6049-4890-a90a-6e636f2d6cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:23.356989 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:08:23.367874 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 563/1135] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Jul 26 00:08:23 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:08:27.424107 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04f5c2-5a34-437f-b504-290bd9b370f2 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:27.424668 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04f5c2-5a34-437f-b504-290bd9b370f2 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:27.424668 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04f5c2-5a34-437f-b504-290bd9b370f2 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:27.425995 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 573/1136] 10.222.0.65 () {54 vars in 961 bytes} [Tue Jul 26 00:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:08:27.431048 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b2e4a-9548-49c4-a41d-229c68327534 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:27.431496 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b2e4a-9548-49c4-a41d-229c68327534 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:27.431630 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b2e4a-9548-49c4-a41d-229c68327534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:27.451580 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-a79b2e4a-9548-49c4-a41d-229c68327534 None None] MFA Rules not processed for user `d88b351fcdad4f2ab1a42e2ac3ee0856`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:08:27.452764 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-a79b2e4a-9548-49c4-a41d-229c68327534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:27.462123 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 564/1137] 10.222.0.65 () {58 vars in 1058 bytes} [Tue Jul 26 00:08:27 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:08:27.469314 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04f5c2-5a34-437f-b504-290bd9b370f2 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:08:27.482256 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04f5c2-5a34-437f-b504-290bd9b370f2 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:08:27.487286 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4df19-7a4b-41ee-aa43-19c3dd3d3adf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88b351fcdad4f2ab1a42e2ac3ee0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:08:27.487899 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4df19-7a4b-41ee-aa43-19c3dd3d3adf service placement] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:27.488177 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4df19-7a4b-41ee-aa43-19c3dd3d3adf service placement] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:27.488449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4df19-7a4b-41ee-aa43-19c3dd3d3adf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:27.496447 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4df19-7a4b-41ee-aa43-19c3dd3d3adf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:08:27.498016 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4df19-7a4b-41ee-aa43-19c3dd3d3adf service placement] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:08:27.508001 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 574/1138] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:08:27 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:08:30.002891 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753ec93-dba3-4a27-94cd-4bd426fdb7bb None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:30.003348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753ec93-dba3-4a27-94cd-4bd426fdb7bb None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:30.003467 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753ec93-dba3-4a27-94cd-4bd426fdb7bb None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:30.004857 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 565/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 00:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:08:30.009813 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fb3a2-b2ba-49b7-b286-047cf8e6e61e None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:30.010316 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fb3a2-b2ba-49b7-b286-047cf8e6e61e None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:30.010425 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fb3a2-b2ba-49b7-b286-047cf8e6e61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:30.029158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-0a5fb3a2-b2ba-49b7-b286-047cf8e6e61e None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:08:30.030328 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-0a5fb3a2-b2ba-49b7-b286-047cf8e6e61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:30.038311 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 575/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 00:08:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:08:30.197094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753ec93-dba3-4a27-94cd-4bd426fdb7bb None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:08:30.210377 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753ec93-dba3-4a27-94cd-4bd426fdb7bb None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:08:30.215211 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09847d-5645-45b4-884e-6561609e10c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:08:30.215806 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09847d-5645-45b4-884e-6561609e10c5 service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:30.216083 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09847d-5645-45b4-884e-6561609e10c5 service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:30.216355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09847d-5645-45b4-884e-6561609e10c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:30.224748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09847d-5645-45b4-884e-6561609e10c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:08:30.226314 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09847d-5645-45b4-884e-6561609e10c5 service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:08:30.235421 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 566/1141] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:08:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:08:31.073933 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf4412-2429-4f19-be92-a07176b87387 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:31.074477 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf4412-2429-4f19-be92-a07176b87387 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:31.074477 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf4412-2429-4f19-be92-a07176b87387 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:31.075828 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 576/1142] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 00:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:08:31.081152 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17392379-36bf-4ad5-b87c-c3a893d955b0 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:31.081563 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17392379-36bf-4ad5-b87c-c3a893d955b0 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:31.081710 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17392379-36bf-4ad5-b87c-c3a893d955b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:31.100871 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-17392379-36bf-4ad5-b87c-c3a893d955b0 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:08:31.102061 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-17392379-36bf-4ad5-b87c-c3a893d955b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:31.109895 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 567/1143] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 00:08:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:08:31.271058 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf4412-2429-4f19-be92-a07176b87387 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:08:31.285147 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf4412-2429-4f19-be92-a07176b87387 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:08:31.289982 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3480d55-1ffe-4ac4-a54a-6677aa24bdaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:08:31.290582 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3480d55-1ffe-4ac4-a54a-6677aa24bdaa service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:31.290891 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3480d55-1ffe-4ac4-a54a-6677aa24bdaa service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:31.291172 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3480d55-1ffe-4ac4-a54a-6677aa24bdaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:31.299397 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3480d55-1ffe-4ac4-a54a-6677aa24bdaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:08:31.300966 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3480d55-1ffe-4ac4-a54a-6677aa24bdaa service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:08:31.310404 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 577/1144] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:08:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:08:35.500522 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c691-d464-4416-ab2a-1372348f6b08 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:35.501141 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c691-d464-4416-ab2a-1372348f6b08 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:35.501141 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c691-d464-4416-ab2a-1372348f6b08 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:35.503138 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 568/1145] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:08:35.508310 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ab625-ded7-448b-821a-da2c58b39613 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:35.508747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ab625-ded7-448b-821a-da2c58b39613 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:35.508861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ab625-ded7-448b-821a-da2c58b39613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:35.528308 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-9a9ab625-ded7-448b-821a-da2c58b39613 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:08:35.529482 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-9a9ab625-ded7-448b-821a-da2c58b39613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:35.537321 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 578/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:08:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:08:35.574938 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c691-d464-4416-ab2a-1372348f6b08 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:08:35.576600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-b349c691-d464-4416-ab2a-1372348f6b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:35.633951 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c691-d464-4416-ab2a-1372348f6b08 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:08:35.637412 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfab8b9-5124-4a70-8f79-1d831608ec60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:08:35.638011 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfab8b9-5124-4a70-8f79-1d831608ec60 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:35.638289 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfab8b9-5124-4a70-8f79-1d831608ec60 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:35.638560 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfab8b9-5124-4a70-8f79-1d831608ec60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:35.648048 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfab8b9-5124-4a70-8f79-1d831608ec60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:08:35.649469 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfab8b9-5124-4a70-8f79-1d831608ec60 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:08:35.658852 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 569/1147] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:08:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:08:37.897546 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb3ce3-4f75-4511-a550-80cdc3c45ed5 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:37.898132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb3ce3-4f75-4511-a550-80cdc3c45ed5 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:37.898132 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb3ce3-4f75-4511-a550-80cdc3c45ed5 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:37.899480 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 579/1148] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:08:37.904654 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b0aec-0269-4c32-82ac-0100694e2a88 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:37.905101 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b0aec-0269-4c32-82ac-0100694e2a88 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:37.905218 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b0aec-0269-4c32-82ac-0100694e2a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:37.924331 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-969b0aec-0269-4c32-82ac-0100694e2a88 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:08:37.925525 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-969b0aec-0269-4c32-82ac-0100694e2a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:37.933596 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 570/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:08:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:08:37.971249 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb3ce3-4f75-4511-a550-80cdc3c45ed5 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:08:37.982100 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb3ce3-4f75-4511-a550-80cdc3c45ed5 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:08:37.985598 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f240af6-097a-4922-901b-e4632dfe6efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:08:37.986219 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f240af6-097a-4922-901b-e4632dfe6efd service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:37.986503 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f240af6-097a-4922-901b-e4632dfe6efd service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:37.986818 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f240af6-097a-4922-901b-e4632dfe6efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:37.996017 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f240af6-097a-4922-901b-e4632dfe6efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:08:37.997447 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f240af6-097a-4922-901b-e4632dfe6efd service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:08:38.007412 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 580/1150] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:08:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:08:41.802491 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cdb4a-3e93-4148-b435-336219d5825a None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:41.803106 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cdb4a-3e93-4148-b435-336219d5825a None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:41.803106 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cdb4a-3e93-4148-b435-336219d5825a None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:41.804406 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 571/1151] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:08:41.809884 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774285-3c3f-4f8b-a82f-f88c17d54f3a None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:41.810294 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774285-3c3f-4f8b-a82f-f88c17d54f3a None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:41.810445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774285-3c3f-4f8b-a82f-f88c17d54f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:41.831805 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-8d774285-3c3f-4f8b-a82f-f88c17d54f3a None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:08:41.833008 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-8d774285-3c3f-4f8b-a82f-f88c17d54f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:41.840757 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 581/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:08:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:08:42.115913 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cdb4a-3e93-4148-b435-336219d5825a None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:08:42.117600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-687cdb4a-3e93-4148-b435-336219d5825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:42.174536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cdb4a-3e93-4148-b435-336219d5825a None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:08:42.178070 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0192609-4346-476b-b85b-fe5d1d25b018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8a981708a34de5be7cda18eb8bb1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:08:42.178678 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0192609-4346-476b-b85b-fe5d1d25b018 service cinder] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:42.178993 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0192609-4346-476b-b85b-fe5d1d25b018 service cinder] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:42.179271 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0192609-4346-476b-b85b-fe5d1d25b018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:42.188419 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0192609-4346-476b-b85b-fe5d1d25b018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:08:42.189870 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0192609-4346-476b-b85b-fe5d1d25b018 service cinder] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:08:42.199222 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 572/1153] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:08:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:08:44.440577 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487820-53f0-41aa-83c4-70fcf53bc779 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:44.441190 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487820-53f0-41aa-83c4-70fcf53bc779 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:44.441190 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487820-53f0-41aa-83c4-70fcf53bc779 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:44.442530 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 582/1154] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 00:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:08:44.447608 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c056101-bd30-4758-adfa-b0c51e5bdaf1 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:44.448067 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c056101-bd30-4758-adfa-b0c51e5bdaf1 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:44.448461 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c056101-bd30-4758-adfa-b0c51e5bdaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:44.468893 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-7c056101-bd30-4758-adfa-b0c51e5bdaf1 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:08:44.470621 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-7c056101-bd30-4758-adfa-b0c51e5bdaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:44.480238 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 573/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 00:08:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:08:44.752915 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487820-53f0-41aa-83c4-70fcf53bc779 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:08:44.754587 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-cb487820-53f0-41aa-83c4-70fcf53bc779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:08:44.768326 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487820-53f0-41aa-83c4-70fcf53bc779 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:08:44.772039 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5c0f4-ea0e-48d9-9cda-afc7d5fc66f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8a981708a34de5be7cda18eb8bb1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:08:44.772660 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5c0f4-ea0e-48d9-9cda-afc7d5fc66f5 service cinder] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:08:44.772936 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5c0f4-ea0e-48d9-9cda-afc7d5fc66f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:08:44.773207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5c0f4-ea0e-48d9-9cda-afc7d5fc66f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:08:44.782075 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5c0f4-ea0e-48d9-9cda-afc7d5fc66f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:08:44.783551 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5c0f4-ea0e-48d9-9cda-afc7d5fc66f5 service cinder] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:08:44.792706 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 583/1156] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:08:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:08:54.463718 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=70 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:08:54.788696 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=75 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:02.523625 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8724c-5b91-4aa8-bc71-26aad3c001ee None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.524251 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8724c-5b91-4aa8-bc71-26aad3c001ee None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.524251 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8724c-5b91-4aa8-bc71-26aad3c001ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.545573 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-1bf8724c-5b91-4aa8-bc71-26aad3c001ee None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:02.546893 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-1bf8724c-5b91-4aa8-bc71-26aad3c001ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:02.554629 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 574/1157] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:10:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:10:02.563330 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8bf8-8a34-4f12-aa02-f745f057b65b None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.563861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8bf8-8a34-4f12-aa02-f745f057b65b None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.563861 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8bf8-8a34-4f12-aa02-f745f057b65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.583254 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-abcc8bf8-8a34-4f12-aa02-f745f057b65b None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:02.584447 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-abcc8bf8-8a34-4f12-aa02-f745f057b65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:02.584936 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c6600-6b8a-435e-bee8-c7315ed2be1d None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.585227 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c6600-6b8a-435e-bee8-c7315ed2be1d None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.585506 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c6600-6b8a-435e-bee8-c7315ed2be1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.593001 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 584/1158] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:10:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:10:02.597377 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8bf8-8a34-4f12-aa02-f745f057b65b None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:02.606194 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8bf8-8a34-4f12-aa02-f745f057b65b None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:02.606360 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-c21c6600-6b8a-435e-bee8-c7315ed2be1d None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:02.608638 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-c21c6600-6b8a-435e-bee8-c7315ed2be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:02.611298 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf00cf9-ef5c-4c62-b044-4a23030138b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:02.611892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf00cf9-ef5c-4c62-b044-4a23030138b8 admin admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.612178 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf00cf9-ef5c-4c62-b044-4a23030138b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.612461 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf00cf9-ef5c-4c62-b044-4a23030138b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.613137 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf00cf9-ef5c-4c62-b044-4a23030138b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:10:02.613485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf00cf9-ef5c-4c62-b044-4a23030138b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:02.614505 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: WARNING py.warnings [None req-dbf00cf9-ef5c-4c62-b044-4a23030138b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:10:02.614505 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: warnings.warn(msg) Jul 26 00:10:02.614505 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: Jul 26 00:10:02.615466 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf00cf9-ef5c-4c62-b044-4a23030138b8 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:02.616601 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 575/1159] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:10:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:10:02.624678 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0072-598b-463f-a916-5a661e10d195 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.624962 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0072-598b-463f-a916-5a661e10d195 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.625235 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0072-598b-463f-a916-5a661e10d195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.634000 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 585/1160] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Jul 26 00:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 00:10:02.635358 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf00cf9-ef5c-4c62-b044-4a23030138b8 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:02.644397 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-ff4d0072-598b-463f-a916-5a661e10d195 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:02.645250 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf00cf9-ef5c-4c62-b044-4a23030138b8 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:02.645593 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-ff4d0072-598b-463f-a916-5a661e10d195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:02.651722 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d1f8f-622f-45ae-9181-ee176c997383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:02.652279 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d1f8f-622f-45ae-9181-ee176c997383 admin admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.652562 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d1f8f-622f-45ae-9181-ee176c997383 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.652855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d1f8f-622f-45ae-9181-ee176c997383 admin admin] PATH_INFO: `/v3/projects` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.653493 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d1f8f-622f-45ae-9181-ee176c997383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:02.655497 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 576/1161] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:10:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:10:02.656344 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d1f8f-622f-45ae-9181-ee176c997383 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:02.659844 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d0072-598b-463f-a916-5a661e10d195 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:02.668738 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d0072-598b-463f-a916-5a661e10d195 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:02.674145 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f5b01-c2ea-4679-88b0-44b2a62fb144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:02.674762 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f5b01-c2ea-4679-88b0-44b2a62fb144 admin admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.675047 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f5b01-c2ea-4679-88b0-44b2a62fb144 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.675319 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f5b01-c2ea-4679-88b0-44b2a62fb144 admin admin] PATH_INFO: `/v3/domains` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.675999 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f5b01-c2ea-4679-88b0-44b2a62fb144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87309) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 00:10:02.676304 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f5b01-c2ea-4679-88b0-44b2a62fb144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:02.677901 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f5b01-c2ea-4679-88b0-44b2a62fb144 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:02.691076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 577/1162] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Jul 26 00:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 00:10:02.698015 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 586/1163] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Jul 26 00:10:02 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 00:10:02.698658 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f5b01-c2ea-4679-88b0-44b2a62fb144 admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:02.699075 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d1f8f-622f-45ae-9181-ee176c997383 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:02.709911 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f5b01-c2ea-4679-88b0-44b2a62fb144 admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:02.761337 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d1f8f-622f-45ae-9181-ee176c997383 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:02.765536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8eda9-39ae-4862-821b-300785a299ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:02.766057 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182b141-1ead-4cc7-9e5a-81c83a051d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:02.766187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8eda9-39ae-4862-821b-300785a299ad admin admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.766446 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8eda9-39ae-4862-821b-300785a299ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.766666 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182b141-1ead-4cc7-9e5a-81c83a051d80 admin admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.766796 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8eda9-39ae-4862-821b-300785a299ad admin admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.766980 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182b141-1ead-4cc7-9e5a-81c83a051d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.767253 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182b141-1ead-4cc7-9e5a-81c83a051d80 admin admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.767394 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8eda9-39ae-4862-821b-300785a299ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:02.767908 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182b141-1ead-4cc7-9e5a-81c83a051d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:02.768407 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: WARNING py.warnings [None req-02b8eda9-39ae-4862-821b-300785a299ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:10:02.768407 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: warnings.warn(msg) Jul 26 00:10:02.768407 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: Jul 26 00:10:02.768906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: WARNING py.warnings [None req-9182b141-1ead-4cc7-9e5a-81c83a051d80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:10:02.768906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: warnings.warn(msg) Jul 26 00:10:02.768906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: Jul 26 00:10:02.769594 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8eda9-39ae-4862-821b-300785a299ad admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:02.770117 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182b141-1ead-4cc7-9e5a-81c83a051d80 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:02.791140 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 587/1164] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Jul 26 00:10:02 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 00:10:02.795406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182b141-1ead-4cc7-9e5a-81c83a051d80 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:02.800827 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 578/1165] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Jul 26 00:10:02 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 00:10:02.801837 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8eda9-39ae-4862-821b-300785a299ad admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:02.805207 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182b141-1ead-4cc7-9e5a-81c83a051d80 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:02.862790 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8eda9-39ae-4862-821b-300785a299ad admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:02.863024 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cb330-01ab-4629-837f-91002c4ecfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:02.863607 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cb330-01ab-4629-837f-91002c4ecfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.863887 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cb330-01ab-4629-837f-91002c4ecfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.864152 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cb330-01ab-4629-837f-91002c4ecfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.864837 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cb330-01ab-4629-837f-91002c4ecfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:02.866432 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cb330-01ab-4629-837f-91002c4ecfe7 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:02.868234 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8e8d0-a5a5-4406-87b1-8d1a1c02fd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:02.869190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8e8d0-a5a5-4406-87b1-8d1a1c02fd5d admin admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.869477 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8e8d0-a5a5-4406-87b1-8d1a1c02fd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.869756 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8e8d0-a5a5-4406-87b1-8d1a1c02fd5d admin admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.870447 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8e8d0-a5a5-4406-87b1-8d1a1c02fd5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:02.872470 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8e8d0-a5a5-4406-87b1-8d1a1c02fd5d admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:02.876903 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 588/1166] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Jul 26 00:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 00:10:02.880874 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cb330-01ab-4629-837f-91002c4ecfe7 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:02.891509 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cb330-01ab-4629-837f-91002c4ecfe7 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:02.898259 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 579/1167] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Jul 26 00:10:02 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 00:10:02.898415 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa37e45-4908-4d6e-966c-daa03d5957fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:02.898415 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa37e45-4908-4d6e-966c-daa03d5957fc admin admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.898415 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa37e45-4908-4d6e-966c-daa03d5957fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.898415 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa37e45-4908-4d6e-966c-daa03d5957fc admin admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.898975 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa37e45-4908-4d6e-966c-daa03d5957fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:02.899345 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8e8d0-a5a5-4406-87b1-8d1a1c02fd5d admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:02.899894 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa37e45-4908-4d6e-966c-daa03d5957fc admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:02.909706 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8e8d0-a5a5-4406-87b1-8d1a1c02fd5d admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:02.910773 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 589/1168] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Jul 26 00:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 00:10:02.914341 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e241e0-9328-49f3-b8c7-75ed162145d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:02.914873 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa37e45-4908-4d6e-966c-daa03d5957fc admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:02.915003 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e241e0-9328-49f3-b8c7-75ed162145d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.915247 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e241e0-9328-49f3-b8c7-75ed162145d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.915526 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e241e0-9328-49f3-b8c7-75ed162145d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.916215 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e241e0-9328-49f3-b8c7-75ed162145d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:02.917850 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e241e0-9328-49f3-b8c7-75ed162145d0 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:02.924838 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa37e45-4908-4d6e-966c-daa03d5957fc admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:02.929031 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 580/1169] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Jul 26 00:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 00:10:02.929506 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f85396-474f-4d4b-8900-e5b8ebbfbcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:02.930191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85396-474f-4d4b-8900-e5b8ebbfbcd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.930474 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85396-474f-4d4b-8900-e5b8ebbfbcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.930803 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85396-474f-4d4b-8900-e5b8ebbfbcd1 admin admin] PATH_INFO: `/v3/projects/6cce7b8438464c409602d9c9b61e6b66/users/7a6f7e4737f74281849fa75181e5120d/roles/5717836a50094587b879206794e7156a` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.933081 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e241e0-9328-49f3-b8c7-75ed162145d0 admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:02.943864 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e241e0-9328-49f3-b8c7-75ed162145d0 admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:02.946937 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f85396-474f-4d4b-8900-e5b8ebbfbcd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cce7b8438464c409602d9c9b61e6b66, user_id=7a6f7e4737f74281849fa75181e5120d, role_id=5717836a50094587b879206794e7156a)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:02.948548 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0dc6d-6b30-4838-9c97-bd9ab7540f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:02.949141 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0dc6d-6b30-4838-9c97-bd9ab7540f1e admin admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.949424 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0dc6d-6b30-4838-9c97-bd9ab7540f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.949624 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f85396-474f-4d4b-8900-e5b8ebbfbcd1 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:02.949729 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0dc6d-6b30-4838-9c97-bd9ab7540f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.950365 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0dc6d-6b30-4838-9c97-bd9ab7540f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:02.952582 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0dc6d-6b30-4838-9c97-bd9ab7540f1e admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:02.959598 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:02.964303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 581/1170] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Jul 26 00:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 00:10:02.965019 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 590/1171] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Jul 26 00:10:02 2022] PUT /identity/v3/projects/6cce7b8438464c409602d9c9b61e6b66/users/7a6f7e4737f74281849fa75181e5120d/roles/5717836a50094587b879206794e7156a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 00:10:02.968600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0dc6d-6b30-4838-9c97-bd9ab7540f1e admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:02.970649 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa8c06-da8b-42f8-9d96-09443e9a09da None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:02.970985 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa8c06-da8b-42f8-9d96-09443e9a09da None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:02.971264 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa8c06-da8b-42f8-9d96-09443e9a09da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:02.979065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0dc6d-6b30-4838-9c97-bd9ab7540f1e admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:02.993956 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-47fa8c06-da8b-42f8-9d96-09443e9a09da None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:02.995232 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-47fa8c06-da8b-42f8-9d96-09443e9a09da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:03.004331 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:03.048349 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6963bad-a0fc-4e6a-b2f6-45f18dd3b19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:03.049024 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6963bad-a0fc-4e6a-b2f6-45f18dd3b19f admin admin] REQUEST_METHOD: `PUT` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:03.049307 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6963bad-a0fc-4e6a-b2f6-45f18dd3b19f admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:03.049580 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6963bad-a0fc-4e6a-b2f6-45f18dd3b19f admin admin] PATH_INFO: `/v3/projects/b8fc93bd2c194a198b116e8048215204/users/2f4210ffab7f47df822b7aaa8bfd0196/roles/5717836a50094587b879206794e7156a` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:03.058682 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 591/1172] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:10:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:10:03.064188 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6963bad-a0fc-4e6a-b2f6-45f18dd3b19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8fc93bd2c194a198b116e8048215204, user_id=2f4210ffab7f47df822b7aaa8bfd0196, role_id=5717836a50094587b879206794e7156a)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:03.065230 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: WARNING py.warnings [None req-f6963bad-a0fc-4e6a-b2f6-45f18dd3b19f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 00:10:03.065230 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: warnings.warn(msg) Jul 26 00:10:03.065230 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: Jul 26 00:10:03.067204 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6963bad-a0fc-4e6a-b2f6-45f18dd3b19f admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:03.069304 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa8c06-da8b-42f8-9d96-09443e9a09da None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:03.083965 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 582/1173] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Jul 26 00:10:02 2022] PUT /identity/v3/projects/b8fc93bd2c194a198b116e8048215204/users/2f4210ffab7f47df822b7aaa8bfd0196/roles/5717836a50094587b879206794e7156a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 00:10:03.088881 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f244b-0d19-4b42-b163-64b4b127a6d3 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:03.089170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f244b-0d19-4b42-b163-64b4b127a6d3 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:03.089449 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f244b-0d19-4b42-b163-64b4b127a6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:03.108151 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-426f244b-0d19-4b42-b163-64b4b127a6d3 None None] MFA Rules not processed for user `4c1cfffdc2f44dac84acffeaa3f395e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:03.109361 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-426f244b-0d19-4b42-b163-64b4b127a6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:03.125948 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa8c06-da8b-42f8-9d96-09443e9a09da None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:03.168457 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 583/1174] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:10:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:10:03.174747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042024c-0cf5-4e38-8662-74b79800d514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:03.175377 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042024c-0cf5-4e38-8662-74b79800d514 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:03.175660 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042024c-0cf5-4e38-8662-74b79800d514 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:03.175937 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042024c-0cf5-4e38-8662-74b79800d514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:03.179553 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f244b-0d19-4b42-b163-64b4b127a6d3 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:03.180900 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-426f244b-0d19-4b42-b163-64b4b127a6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:03.185772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042024c-0cf5-4e38-8662-74b79800d514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:03.187556 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042024c-0cf5-4e38-8662-74b79800d514 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:03.197045 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 592/1175] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:10:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 00:10:03.205664 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f244b-0d19-4b42-b163-64b4b127a6d3 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:03.209681 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b8156-c2cb-4dd3-9aaa-463b75417ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:03.210371 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b8156-c2cb-4dd3-9aaa-463b75417ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:03.210657 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b8156-c2cb-4dd3-9aaa-463b75417ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:03.210963 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b8156-c2cb-4dd3-9aaa-463b75417ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:03.220426 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b8156-c2cb-4dd3-9aaa-463b75417ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:03.221878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b8156-c2cb-4dd3-9aaa-463b75417ba3 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:03.231590 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 584/1176] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:10:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 00:10:09.336442 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92aebc-001e-4f1c-bdd3-a134c20820c9 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:09.337019 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92aebc-001e-4f1c-bdd3-a134c20820c9 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:09.337019 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92aebc-001e-4f1c-bdd3-a134c20820c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:09.375753 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-fd92aebc-001e-4f1c-bdd3-a134c20820c9 None None] MFA Rules not processed for user `2f4210ffab7f47df822b7aaa8bfd0196`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:09.377024 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-fd92aebc-001e-4f1c-bdd3-a134c20820c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:09.437801 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=100 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:09.494361 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 593/1177] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:10:09 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:10:09.495626 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b8156-c2cb-4dd3-9aaa-463b75417ba3 service neutron] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:09.517431 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b8156-c2cb-4dd3-9aaa-463b75417ba3 service neutron] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:09.522344 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84752d-a23a-4164-b84d-fce07a7457b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:09.523000 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84752d-a23a-4164-b84d-fce07a7457b2 admin admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:09.523276 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84752d-a23a-4164-b84d-fce07a7457b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:09.523544 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84752d-a23a-4164-b84d-fce07a7457b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:09.524208 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84752d-a23a-4164-b84d-fce07a7457b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:09.526126 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84752d-a23a-4164-b84d-fce07a7457b2 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:09.570187 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 585/1178] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Jul 26 00:10:09 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 00:10:09.574049 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92aebc-001e-4f1c-bdd3-a134c20820c9 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:09.587737 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92aebc-001e-4f1c-bdd3-a134c20820c9 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:09.644407 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809b057-fd14-4481-b3ad-f19ab84e09de None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:09.644745 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809b057-fd14-4481-b3ad-f19ab84e09de None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:09.645022 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809b057-fd14-4481-b3ad-f19ab84e09de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:09.676966 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-8809b057-fd14-4481-b3ad-f19ab84e09de None None] MFA Rules not processed for user `7a6f7e4737f74281849fa75181e5120d`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:09.678195 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-8809b057-fd14-4481-b3ad-f19ab84e09de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:09.684090 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b127c17-facb-47ae-8e9f-e6b6b0817366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:09.686608 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b127c17-facb-47ae-8e9f-e6b6b0817366 admin admin] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:09.691304 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b127c17-facb-47ae-8e9f-e6b6b0817366 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:09.693326 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b127c17-facb-47ae-8e9f-e6b6b0817366 admin admin] PATH_INFO: `/v3/users` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:09.694303 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b127c17-facb-47ae-8e9f-e6b6b0817366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:09.701647 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b127c17-facb-47ae-8e9f-e6b6b0817366 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:09.738189 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 594/1179] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Jul 26 00:10:09 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 00:10:09.739477 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b127c17-facb-47ae-8e9f-e6b6b0817366 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:09.741327 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:09.754168 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b127c17-facb-47ae-8e9f-e6b6b0817366 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:09.760043 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98567dcf-560d-41a6-b9f9-7303bedaf42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:09.760699 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98567dcf-560d-41a6-b9f9-7303bedaf42b admin admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:09.760990 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98567dcf-560d-41a6-b9f9-7303bedaf42b admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:09.761265 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98567dcf-560d-41a6-b9f9-7303bedaf42b admin admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:09.761962 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98567dcf-560d-41a6-b9f9-7303bedaf42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:09.764156 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98567dcf-560d-41a6-b9f9-7303bedaf42b admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:09.767793 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 586/1180] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:10:09 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:10:09.772312 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809b057-fd14-4481-b3ad-f19ab84e09de None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:09.775146 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 595/1181] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Jul 26 00:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 00:10:09.779749 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98567dcf-560d-41a6-b9f9-7303bedaf42b admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:09.787818 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809b057-fd14-4481-b3ad-f19ab84e09de None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:09.791667 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98567dcf-560d-41a6-b9f9-7303bedaf42b admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:09.792439 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67fd8d-bbfa-40c9-b18d-dacda0fc0da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:09.793060 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67fd8d-bbfa-40c9-b18d-dacda0fc0da6 admin admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:09.793349 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67fd8d-bbfa-40c9-b18d-dacda0fc0da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:09.793625 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67fd8d-bbfa-40c9-b18d-dacda0fc0da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:09.795024 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67fd8d-bbfa-40c9-b18d-dacda0fc0da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:09.797122 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646607a7-a4ce-44c1-851d-65e76fecc078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:09.797271 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67fd8d-bbfa-40c9-b18d-dacda0fc0da6 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:09.797830 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646607a7-a4ce-44c1-851d-65e76fecc078 admin admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:09.798147 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646607a7-a4ce-44c1-851d-65e76fecc078 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:09.798394 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646607a7-a4ce-44c1-851d-65e76fecc078 admin admin] PATH_INFO: `/v3/projects/c2fa795dc0724245b62113678acde975/users/28d814fbdd874024a8e28a0f24a740a7/roles/5d947b934e0642c5a4ab00d547ec3fda` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:09.816662 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646607a7-a4ce-44c1-851d-65e76fecc078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2fa795dc0724245b62113678acde975, user_id=28d814fbdd874024a8e28a0f24a740a7, role_id=5d947b934e0642c5a4ab00d547ec3fda)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:09.819586 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646607a7-a4ce-44c1-851d-65e76fecc078 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:09.830178 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 587/1182] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Jul 26 00:10:09 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 00:10:09.834262 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67fd8d-bbfa-40c9-b18d-dacda0fc0da6 admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:09.836220 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 596/1183] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Jul 26 00:10:09 2022] PUT /identity/v3/projects/c2fa795dc0724245b62113678acde975/users/28d814fbdd874024a8e28a0f24a740a7/roles/5d947b934e0642c5a4ab00d547ec3fda => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 00:10:09.840204 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646607a7-a4ce-44c1-851d-65e76fecc078 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:09.929813 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646607a7-a4ce-44c1-851d-65e76fecc078 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:09.933872 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67fd8d-bbfa-40c9-b18d-dacda0fc0da6 admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:09.935150 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf4443-d9e7-4fd9-95b3-375236f8f538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:09.935782 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf4443-d9e7-4fd9-95b3-375236f8f538 admin admin] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:09.936067 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf4443-d9e7-4fd9-95b3-375236f8f538 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:09.936343 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf4443-d9e7-4fd9-95b3-375236f8f538 admin admin] PATH_INFO: `/v3/roles` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:09.937032 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf4443-d9e7-4fd9-95b3-375236f8f538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:09.938662 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf4443-d9e7-4fd9-95b3-375236f8f538 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:09.939214 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92007520-e7e3-4c45-ba8f-2b568c5aa46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:09.939902 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92007520-e7e3-4c45-ba8f-2b568c5aa46c admin admin] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:09.940834 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92007520-e7e3-4c45-ba8f-2b568c5aa46c admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:09.941117 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92007520-e7e3-4c45-ba8f-2b568c5aa46c admin admin] PATH_INFO: `/v3/users` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:09.941792 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92007520-e7e3-4c45-ba8f-2b568c5aa46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:09.943783 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92007520-e7e3-4c45-ba8f-2b568c5aa46c admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:09.950152 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 597/1184] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Jul 26 00:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 00:10:09.957658 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf4443-d9e7-4fd9-95b3-375236f8f538 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:09.971487 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf4443-d9e7-4fd9-95b3-375236f8f538 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:09.978399 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 588/1185] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Jul 26 00:10:09 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 00:10:09.982050 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92007520-e7e3-4c45-ba8f-2b568c5aa46c admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:09.985303 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb5c3c-4b0a-4b4a-9684-fbf0f12fb4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:09.989973 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5c3c-4b0a-4b4a-9684-fbf0f12fb4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:09.990393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5c3c-4b0a-4b4a-9684-fbf0f12fb4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:09.990808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5c3c-4b0a-4b4a-9684-fbf0f12fb4d9 admin admin] PATH_INFO: `/v3/projects/c2fa795dc0724245b62113678acde975/users/28d814fbdd874024a8e28a0f24a740a7/roles/5d947b934e0642c5a4ab00d547ec3fda` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:09.992897 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92007520-e7e3-4c45-ba8f-2b568c5aa46c admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:09.995230 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb5c3c-4b0a-4b4a-9684-fbf0f12fb4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2fa795dc0724245b62113678acde975, user_id=28d814fbdd874024a8e28a0f24a740a7, role_id=5d947b934e0642c5a4ab00d547ec3fda)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:10.000066 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb5c3c-4b0a-4b4a-9684-fbf0f12fb4d9 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:10.000602 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb2b20-0275-4d25-9c47-1933a96b3e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:10.001229 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2b20-0275-4d25-9c47-1933a96b3e15 admin admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:10.001501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2b20-0275-4d25-9c47-1933a96b3e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:10.001765 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2b20-0275-4d25-9c47-1933a96b3e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:10.002464 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb2b20-0275-4d25-9c47-1933a96b3e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:10.004126 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb2b20-0275-4d25-9c47-1933a96b3e15 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:10.013449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 598/1186] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Jul 26 00:10:09 2022] PUT /identity/v3/projects/c2fa795dc0724245b62113678acde975/users/28d814fbdd874024a8e28a0f24a740a7/roles/5d947b934e0642c5a4ab00d547ec3fda => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:10:10.018987 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb5c3c-4b0a-4b4a-9684-fbf0f12fb4d9 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:10.020923 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 589/1187] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Jul 26 00:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 00:10:10.058456 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:10.099407 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb5c3c-4b0a-4b4a-9684-fbf0f12fb4d9 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:10.104686 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c72be2-5069-4a99-9e0c-7c17776bb213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:10.105603 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c72be2-5069-4a99-9e0c-7c17776bb213 admin admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:10.106184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c72be2-5069-4a99-9e0c-7c17776bb213 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:10.106743 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c72be2-5069-4a99-9e0c-7c17776bb213 admin admin] PATH_INFO: `/v3/projects/4f67ffde61fb433a8dba35bdf89e5043/users/9c955b6515364b289edced764104a162/roles/5d947b934e0642c5a4ab00d547ec3fda` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:10.129221 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c72be2-5069-4a99-9e0c-7c17776bb213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f67ffde61fb433a8dba35bdf89e5043, user_id=9c955b6515364b289edced764104a162, role_id=5d947b934e0642c5a4ab00d547ec3fda)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:10.132404 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c72be2-5069-4a99-9e0c-7c17776bb213 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:10.149882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 599/1188] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Jul 26 00:10:10 2022] PUT /identity/v3/projects/4f67ffde61fb433a8dba35bdf89e5043/users/9c955b6515364b289edced764104a162/roles/5d947b934e0642c5a4ab00d547ec3fda => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:10:10.154499 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb2b20-0275-4d25-9c47-1933a96b3e15 admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:10.167632 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb2b20-0275-4d25-9c47-1933a96b3e15 admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:10.250134 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4887b-7ba2-47db-8565-cece0c52a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:10.250985 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4887b-7ba2-47db-8565-cece0c52a9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:10.251394 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4887b-7ba2-47db-8565-cece0c52a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:10.251779 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4887b-7ba2-47db-8565-cece0c52a9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:10.252598 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4887b-7ba2-47db-8565-cece0c52a9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:10.254361 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4887b-7ba2-47db-8565-cece0c52a9a2 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:10.269974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 590/1189] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Jul 26 00:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 00:10:10.273913 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c72be2-5069-4a99-9e0c-7c17776bb213 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:10.286406 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c72be2-5069-4a99-9e0c-7c17776bb213 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:10.291868 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611de1-1434-4b1d-8a74-6584e2ccbf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:10.292679 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611de1-1434-4b1d-8a74-6584e2ccbf81 admin admin] REQUEST_METHOD: `PUT` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:10.293114 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611de1-1434-4b1d-8a74-6584e2ccbf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:10.293470 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611de1-1434-4b1d-8a74-6584e2ccbf81 admin admin] PATH_INFO: `/v3/projects/4f67ffde61fb433a8dba35bdf89e5043/users/9c955b6515364b289edced764104a162/roles/5d947b934e0642c5a4ab00d547ec3fda` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:10.297053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab611de1-1434-4b1d-8a74-6584e2ccbf81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f67ffde61fb433a8dba35bdf89e5043, user_id=9c955b6515364b289edced764104a162, role_id=5d947b934e0642c5a4ab00d547ec3fda)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:10.300145 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab611de1-1434-4b1d-8a74-6584e2ccbf81 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:10.324319 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 600/1190] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Jul 26 00:10:10 2022] PUT /identity/v3/projects/4f67ffde61fb433a8dba35bdf89e5043/users/9c955b6515364b289edced764104a162/roles/5d947b934e0642c5a4ab00d547ec3fda => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:10:16.517376 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55ed6c-6e7c-4183-8c0a-630b7280b911 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:16.517891 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55ed6c-6e7c-4183-8c0a-630b7280b911 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:16.517997 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55ed6c-6e7c-4183-8c0a-630b7280b911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:16.606223 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-0f55ed6c-6e7c-4183-8c0a-630b7280b911 None None] MFA Rules not processed for user `28d814fbdd874024a8e28a0f24a740a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:16.607456 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-0f55ed6c-6e7c-4183-8c0a-630b7280b911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:16.712325 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:16.858786 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 591/1191] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:10:16 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:10:16.875987 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611de1-1434-4b1d-8a74-6584e2ccbf81 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:16.883570 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-ab611de1-1434-4b1d-8a74-6584e2ccbf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:17.205265 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611de1-1434-4b1d-8a74-6584e2ccbf81 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:17.237179 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84c043-6f20-44f9-941e-4441b52e45d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc09289c7e645b189776f109b78968e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:17.237373 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84c043-6f20-44f9-941e-4441b52e45d7 service glance] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:17.243188 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84c043-6f20-44f9-941e-4441b52e45d7 service glance] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:17.243487 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84c043-6f20-44f9-941e-4441b52e45d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:17.382410 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d7ddd-738d-4dc7-ac93-08158da8d301 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:17.383955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d7ddd-738d-4dc7-ac93-08158da8d301 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:17.386196 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d7ddd-738d-4dc7-ac93-08158da8d301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:17.414503 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84c043-6f20-44f9-941e-4441b52e45d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:17.420733 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84c043-6f20-44f9-941e-4441b52e45d7 service glance] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:17.498209 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-c02d7ddd-738d-4dc7-ac93-08158da8d301 None None] MFA Rules not processed for user `9c955b6515364b289edced764104a162`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:17.499447 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-c02d7ddd-738d-4dc7-ac93-08158da8d301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:17.502312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 601/1192] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:10:16 2022] GET /identity/v3/auth/tokens => generated 2802 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:10:17.696145 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 592/1193] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:10:17 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:10:17.720190 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84c043-6f20-44f9-941e-4441b52e45d7 service glance] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:17.721747 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-ca84c043-6f20-44f9-941e-4441b52e45d7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:17.740732 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84c043-6f20-44f9-941e-4441b52e45d7 service glance] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:17.746545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae69fb-bda3-431e-9231-7ca6bc45c28e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc09289c7e645b189776f109b78968e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:17.749071 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae69fb-bda3-431e-9231-7ca6bc45c28e service glance] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:17.749554 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae69fb-bda3-431e-9231-7ca6bc45c28e service glance] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:17.750053 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae69fb-bda3-431e-9231-7ca6bc45c28e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:17.806172 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:17.838921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae69fb-bda3-431e-9231-7ca6bc45c28e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:17.840220 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae69fb-bda3-431e-9231-7ca6bc45c28e service glance] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:17.853055 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 602/1194] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:10:17 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:10:26.489303 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd727df-023d-4898-b9af-843062d1ccd6 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:26.489817 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd727df-023d-4898-b9af-843062d1ccd6 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:26.489914 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd727df-023d-4898-b9af-843062d1ccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:26.511604 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-bdd727df-023d-4898-b9af-843062d1ccd6 None None] MFA Rules not processed for user `7a6f7e4737f74281849fa75181e5120d`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:26.512971 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-bdd727df-023d-4898-b9af-843062d1ccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:26.520246 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 593/1195] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:10:26 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:10:26.833602 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e206c5-2aef-4732-8600-10c49f52bfcc None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:26.834194 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e206c5-2aef-4732-8600-10c49f52bfcc None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:26.834194 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e206c5-2aef-4732-8600-10c49f52bfcc None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:26.835694 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 603/1196] 10.222.0.65 () {54 vars in 962 bytes} [Tue Jul 26 00:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:10:26.841189 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b2ad-ccc7-47f5-943a-c8a889a243ee None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:26.841597 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b2ad-ccc7-47f5-943a-c8a889a243ee None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:26.841983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b2ad-ccc7-47f5-943a-c8a889a243ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:26.877980 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-41c1b2ad-ccc7-47f5-943a-c8a889a243ee None None] MFA Rules not processed for user `a513753b2f49408baf24402f1fa3c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:26.879256 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-41c1b2ad-ccc7-47f5-943a-c8a889a243ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:26.955712 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 594/1197] 10.222.0.65 () {58 vars in 1059 bytes} [Tue Jul 26 00:10:26 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:10:26.961363 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350199a-8e25-4040-8630-61cf8d66ea39 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:26.961588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350199a-8e25-4040-8630-61cf8d66ea39 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:26.961862 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350199a-8e25-4040-8630-61cf8d66ea39 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:26.963467 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 604/1198] 10.222.0.65 () {54 vars in 912 bytes} [Tue Jul 26 00:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:10:26.969773 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d07997-eb8d-4d07-a0e9-386ffe511cad None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:26.970076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d07997-eb8d-4d07-a0e9-386ffe511cad None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:26.970355 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d07997-eb8d-4d07-a0e9-386ffe511cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:27.001133 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-d9d07997-eb8d-4d07-a0e9-386ffe511cad None None] MFA Rules not processed for user `a513753b2f49408baf24402f1fa3c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:27.002348 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-d9d07997-eb8d-4d07-a0e9-386ffe511cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:27.013774 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 595/1199] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Jul 26 00:10:26 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:10:27.025059 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350199a-8e25-4040-8630-61cf8d66ea39 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:27.041532 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350199a-8e25-4040-8630-61cf8d66ea39 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:27.046087 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a7864-c982-4c97-a32f-9916c18da6a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc09289c7e645b189776f109b78968e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:27.046993 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a7864-c982-4c97-a32f-9916c18da6a4 service glance] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:27.047534 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a7864-c982-4c97-a32f-9916c18da6a4 service glance] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:27.047884 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a7864-c982-4c97-a32f-9916c18da6a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:27.059042 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a7864-c982-4c97-a32f-9916c18da6a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:27.060311 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a7864-c982-4c97-a32f-9916c18da6a4 service glance] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:27.070892 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 605/1200] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:10:27 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:10:27.614115 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336086a-5acb-4bab-b826-5c5491b1f1c9 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:27.614655 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336086a-5acb-4bab-b826-5c5491b1f1c9 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:27.614655 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336086a-5acb-4bab-b826-5c5491b1f1c9 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:27.616065 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 596/1201] 10.222.0.65 () {54 vars in 912 bytes} [Tue Jul 26 00:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:10:27.623691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338577-bd88-43e8-ad4e-a4c4303357b9 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:27.624270 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338577-bd88-43e8-ad4e-a4c4303357b9 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:27.624553 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338577-bd88-43e8-ad4e-a4c4303357b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:27.656173 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-8a338577-bd88-43e8-ad4e-a4c4303357b9 None None] MFA Rules not processed for user `d4e34b7f817f452faabd2d32d1af3ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:27.657568 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-8a338577-bd88-43e8-ad4e-a4c4303357b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:27.790387 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 606/1202] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Jul 26 00:10:27 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:10:27.802831 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336086a-5acb-4bab-b826-5c5491b1f1c9 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:27.816453 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336086a-5acb-4bab-b826-5c5491b1f1c9 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:27.821736 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d015f-1735-4e6c-b111-ae3a3e5af15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:27.823306 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d015f-1735-4e6c-b111-ae3a3e5af15f service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:27.824046 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d015f-1735-4e6c-b111-ae3a3e5af15f service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:27.826516 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d015f-1735-4e6c-b111-ae3a3e5af15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:27.845914 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d015f-1735-4e6c-b111-ae3a3e5af15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:27.848488 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d015f-1735-4e6c-b111-ae3a3e5af15f service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:27.865002 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 597/1203] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:10:27 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:10:28.384335 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851443-3f73-4758-b1b4-07a7c251eeeb None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:28.384906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851443-3f73-4758-b1b4-07a7c251eeeb None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:28.384906 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851443-3f73-4758-b1b4-07a7c251eeeb None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:28.386512 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 607/1204] 10.222.0.65 () {54 vars in 962 bytes} [Tue Jul 26 00:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:10:28.392942 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbaaba-6591-4e49-9c63-a46dea138923 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:28.393229 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbaaba-6591-4e49-9c63-a46dea138923 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:28.393534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbaaba-6591-4e49-9c63-a46dea138923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:28.414981 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b507d5-4751-484a-a40d-0daba33d3604 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:28.415539 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b507d5-4751-484a-a40d-0daba33d3604 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:28.415914 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b507d5-4751-484a-a40d-0daba33d3604 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:28.417473 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 608/1205] 10.222.0.65 () {54 vars in 961 bytes} [Tue Jul 26 00:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 00:10:28.417617 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-7cfbaaba-6591-4e49-9c63-a46dea138923 None None] MFA Rules not processed for user `a513753b2f49408baf24402f1fa3c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:28.419223 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-7cfbaaba-6591-4e49-9c63-a46dea138923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:28.427441 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cc8cb-7a63-4971-9e95-e1811b58b2ed None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:28.427627 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cc8cb-7a63-4971-9e95-e1811b58b2ed None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:28.428093 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cc8cb-7a63-4971-9e95-e1811b58b2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:28.435626 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 598/1206] 10.222.0.65 () {58 vars in 1059 bytes} [Tue Jul 26 00:10:28 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:10:28.442025 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467999a-42d9-4fa2-bf38-697e1cc4429e None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:28.442389 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467999a-42d9-4fa2-bf38-697e1cc4429e None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:28.442791 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467999a-42d9-4fa2-bf38-697e1cc4429e None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:28.444352 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 599/1207] 10.222.0.65 () {54 vars in 912 bytes} [Tue Jul 26 00:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 00:10:28.450807 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c102890-b8e8-4999-b56e-f8c8c83ab961 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:28.451170 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c102890-b8e8-4999-b56e-f8c8c83ab961 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:28.451655 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c102890-b8e8-4999-b56e-f8c8c83ab961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:28.464161 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=100 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:28.466766 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-536cc8cb-7a63-4971-9e95-e1811b58b2ed None None] MFA Rules not processed for user `d88b351fcdad4f2ab1a42e2ac3ee0856`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:28.468390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-536cc8cb-7a63-4971-9e95-e1811b58b2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:28.487358 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-5c102890-b8e8-4999-b56e-f8c8c83ab961 None None] MFA Rules not processed for user `a513753b2f49408baf24402f1fa3c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:28.488786 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-5c102890-b8e8-4999-b56e-f8c8c83ab961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:28.498746 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 600/1208] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Jul 26 00:10:28 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:10:28.513210 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c102890-b8e8-4999-b56e-f8c8c83ab961 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:28.531696 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c102890-b8e8-4999-b56e-f8c8c83ab961 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:28.544028 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f77967-707e-44b7-9fe9-a990be90a3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:28.545264 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f77967-707e-44b7-9fe9-a990be90a3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:28.545412 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f77967-707e-44b7-9fe9-a990be90a3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:28.545609 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f77967-707e-44b7-9fe9-a990be90a3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:28.558501 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f77967-707e-44b7-9fe9-a990be90a3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:28.560524 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f77967-707e-44b7-9fe9-a990be90a3e6 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:28.581949 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 609/1209] 10.222.0.65 () {58 vars in 1058 bytes} [Tue Jul 26 00:10:28 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:10:28.589468 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 601/1210] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:10:28 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 00:10:28.591834 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cc8cb-7a63-4971-9e95-e1811b58b2ed None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:28.604424 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cc8cb-7a63-4971-9e95-e1811b58b2ed None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:28.616078 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024716d-3e30-47e1-bf9d-13d9c1aafb5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88b351fcdad4f2ab1a42e2ac3ee0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:28.616721 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024716d-3e30-47e1-bf9d-13d9c1aafb5f service placement] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:28.617015 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024716d-3e30-47e1-bf9d-13d9c1aafb5f service placement] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:28.618158 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024716d-3e30-47e1-bf9d-13d9c1aafb5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:28.620393 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-8024716d-3e30-47e1-bf9d-13d9c1aafb5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:28.647396 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024716d-3e30-47e1-bf9d-13d9c1aafb5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:28.649668 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024716d-3e30-47e1-bf9d-13d9c1aafb5f service placement] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:28.667478 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 610/1211] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:10:28 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:10:38.567247 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=8 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:38.658413 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=74 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:39.892035 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a94b4a-24bc-4cca-b3dc-c2677c8d7efc None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:39.892903 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a94b4a-24bc-4cca-b3dc-c2677c8d7efc None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:39.893370 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a94b4a-24bc-4cca-b3dc-c2677c8d7efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:39.929006 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-f0a94b4a-24bc-4cca-b3dc-c2677c8d7efc None None] MFA Rules not processed for user `d4e34b7f817f452faabd2d32d1af3ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:39.930958 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-f0a94b4a-24bc-4cca-b3dc-c2677c8d7efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:39.950003 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 602/1212] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Jul 26 00:10:39 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:10:39.967807 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024716d-3e30-47e1-bf9d-13d9c1aafb5f service placement] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:39.978725 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024716d-3e30-47e1-bf9d-13d9c1aafb5f service placement] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:39.983321 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fcdcc-392f-4888-a800-9bf27504f435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:39.984055 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fcdcc-392f-4888-a800-9bf27504f435 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:39.984326 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fcdcc-392f-4888-a800-9bf27504f435 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:39.984606 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fcdcc-392f-4888-a800-9bf27504f435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:39.992720 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fcdcc-392f-4888-a800-9bf27504f435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:39.994180 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fcdcc-392f-4888-a800-9bf27504f435 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:40.003917 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 611/1213] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:10:39 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:10:40.804820 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393630-0111-4637-ab35-f8f28e251dca None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:40.805097 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393630-0111-4637-ab35-f8f28e251dca None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:40.805396 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393630-0111-4637-ab35-f8f28e251dca None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:40.811033 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 603/1214] 10.222.0.65 () {54 vars in 921 bytes} [Tue Jul 26 00:10:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:10:40.843850 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e4d4e-494f-4c89-bf09-d56ef91b7625 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:40.844248 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e4d4e-494f-4c89-bf09-d56ef91b7625 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:40.844565 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e4d4e-494f-4c89-bf09-d56ef91b7625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:40.867083 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-ee9e4d4e-494f-4c89-bf09-d56ef91b7625 None None] MFA Rules not processed for user `a513753b2f49408baf24402f1fa3c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:40.868292 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-ee9e4d4e-494f-4c89-bf09-d56ef91b7625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:40.882878 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 612/1215] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Jul 26 00:10:40 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:10:40.911606 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f393630-0111-4637-ab35-f8f28e251dca None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:40.931552 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f393630-0111-4637-ab35-f8f28e251dca None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:40.945934 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984f832-df7a-4318-9176-76ea4ac545aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:40.954993 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984f832-df7a-4318-9176-76ea4ac545aa service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:40.955402 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984f832-df7a-4318-9176-76ea4ac545aa service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:40.955704 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984f832-df7a-4318-9176-76ea4ac545aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:40.968126 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984f832-df7a-4318-9176-76ea4ac545aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:40.969826 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984f832-df7a-4318-9176-76ea4ac545aa service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:40.996805 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 604/1216] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:10:40 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:10:47.271772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cfcb4-e5eb-4960-8d9c-b6766c5a6a39 None None] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:47.271772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cfcb4-e5eb-4960-8d9c-b6766c5a6a39 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:47.271772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cfcb4-e5eb-4960-8d9c-b6766c5a6a39 None None] PATH_INFO: `/` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:47.272524 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 613/1217] 10.222.0.65 () {54 vars in 921 bytes} [Tue Jul 26 00:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:10:47.281963 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a00f-8fb7-4df7-bec6-4aaecc669921 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:47.282977 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a00f-8fb7-4df7-bec6-4aaecc669921 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:47.283462 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a00f-8fb7-4df7-bec6-4aaecc669921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:47.313912 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-7720a00f-8fb7-4df7-bec6-4aaecc669921 None None] MFA Rules not processed for user `a513753b2f49408baf24402f1fa3c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:10:47.313912 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-7720a00f-8fb7-4df7-bec6-4aaecc669921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:10:47.317482 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 605/1218] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Jul 26 00:10:47 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:10:47.334187 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cfcb4-e5eb-4960-8d9c-b6766c5a6a39 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:47.349179 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cfcb4-e5eb-4960-8d9c-b6766c5a6a39 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:47.354921 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedb7ab-8542-4dcd-95e5-6c976a860358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:47.355543 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedb7ab-8542-4dcd-95e5-6c976a860358 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:47.356491 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedb7ab-8542-4dcd-95e5-6c976a860358 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:47.356491 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedb7ab-8542-4dcd-95e5-6c976a860358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:47.365052 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedb7ab-8542-4dcd-95e5-6c976a860358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:47.366634 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedb7ab-8542-4dcd-95e5-6c976a860358 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:47.376780 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 614/1219] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:10:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:10:57.298341 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=12 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:57.372413 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=15 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:10:58.238784 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a00f-8fb7-4df7-bec6-4aaecc669921 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:10:58.247925 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a00f-8fb7-4df7-bec6-4aaecc669921 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:10:58.251574 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d2e3b-1a56-4be6-b427-2254833db286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:10:58.252193 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d2e3b-1a56-4be6-b427-2254833db286 service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:10:58.252476 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d2e3b-1a56-4be6-b427-2254833db286 service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:10:58.252754 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d2e3b-1a56-4be6-b427-2254833db286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:10:58.261879 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d2e3b-1a56-4be6-b427-2254833db286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:10:58.263853 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d2e3b-1a56-4be6-b427-2254833db286 service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:10:58.273311 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 606/1220] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:10:58 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:11:08.269161 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=6 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:11:18.912545 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3035ffe-569e-48c1-a8af-fc6c27f1e246 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:11:18.913092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3035ffe-569e-48c1-a8af-fc6c27f1e246 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:11:18.913092 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3035ffe-569e-48c1-a8af-fc6c27f1e246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:11:18.932436 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-a3035ffe-569e-48c1-a8af-fc6c27f1e246 None None] MFA Rules not processed for user `2f4210ffab7f47df822b7aaa8bfd0196`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:11:18.933655 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-a3035ffe-569e-48c1-a8af-fc6c27f1e246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:11:18.940483 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 615/1221] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:11:18 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:11:19.258593 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09567617-19fb-4d27-94ed-ceb573ddd349 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:11:19.259150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09567617-19fb-4d27-94ed-ceb573ddd349 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:11:19.259150 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09567617-19fb-4d27-94ed-ceb573ddd349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:11:19.279190 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-09567617-19fb-4d27-94ed-ceb573ddd349 None None] MFA Rules not processed for user `d4e34b7f817f452faabd2d32d1af3ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:11:19.280369 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-09567617-19fb-4d27-94ed-ceb573ddd349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:11:19.286983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 607/1222] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Jul 26 00:11:19 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:11:19.297927 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3035ffe-569e-48c1-a8af-fc6c27f1e246 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:11:19.307410 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3035ffe-569e-48c1-a8af-fc6c27f1e246 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:11:19.311095 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591e3f4-f05e-4423-b659-635822ad7425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:11:19.311698 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591e3f4-f05e-4423-b659-635822ad7425 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:11:19.311977 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591e3f4-f05e-4423-b659-635822ad7425 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:11:19.312251 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591e3f4-f05e-4423-b659-635822ad7425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:11:19.319895 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591e3f4-f05e-4423-b659-635822ad7425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:11:19.321313 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591e3f4-f05e-4423-b659-635822ad7425 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:11:19.329581 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 616/1223] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:11:19 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:11:29.273657 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=3 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:11:29.326261 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=9 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:11:42.019320 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a872e-c442-4785-acf0-ab9a1c90c02b None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:11:42.019781 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a872e-c442-4785-acf0-ab9a1c90c02b None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:11:42.019888 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a872e-c442-4785-acf0-ab9a1c90c02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:11:42.038982 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-183a872e-c442-4785-acf0-ab9a1c90c02b None None] MFA Rules not processed for user `2f4210ffab7f47df822b7aaa8bfd0196`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:11:42.040155 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-183a872e-c442-4785-acf0-ab9a1c90c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:11:42.047525 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 608/1224] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:11:42 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:11:52.033859 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=3 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:11:55.370240 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5704f4-b5d2-4740-82b7-08aac8dacb74 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:11:55.370680 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5704f4-b5d2-4740-82b7-08aac8dacb74 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:11:55.370819 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5704f4-b5d2-4740-82b7-08aac8dacb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:11:55.389694 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-cd5704f4-b5d2-4740-82b7-08aac8dacb74 None None] MFA Rules not processed for user `2f4210ffab7f47df822b7aaa8bfd0196`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:11:55.390930 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-cd5704f4-b5d2-4740-82b7-08aac8dacb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:11:55.397590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 617/1225] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:11:55 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:12:05.384683 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=3 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:12:50.516171 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eecf89-8c56-441c-a694-b8c6a6d2dc86 None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:12:50.516653 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eecf89-8c56-441c-a694-b8c6a6d2dc86 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:12:50.516748 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eecf89-8c56-441c-a694-b8c6a6d2dc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:12:50.536027 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-e9eecf89-8c56-441c-a694-b8c6a6d2dc86 None None] MFA Rules not processed for user `2f4210ffab7f47df822b7aaa8bfd0196`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:12:50.537213 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-e9eecf89-8c56-441c-a694-b8c6a6d2dc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:12:50.544830 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 609/1226] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:12:50 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:13:00.530588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=3 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:13:02.281822 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5704f4-b5d2-4740-82b7-08aac8dacb74 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:13:02.300151 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5704f4-b5d2-4740-82b7-08aac8dacb74 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:13:02.303720 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa5fba-c080-46c5-a75a-3868b243d86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:13:02.305034 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5fba-c080-46c5-a75a-3868b243d86e service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:13:02.305319 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5fba-c080-46c5-a75a-3868b243d86e service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:13:02.305851 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5fba-c080-46c5-a75a-3868b243d86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:13:02.314625 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa5fba-c080-46c5-a75a-3868b243d86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:13:02.316071 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa5fba-c080-46c5-a75a-3868b243d86e service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:13:02.325929 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 618/1227] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:13:02 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:13:04.260034 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ffc70-4124-4faa-b6f0-c0b451e75c2a None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:13:04.260551 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ffc70-4124-4faa-b6f0-c0b451e75c2a None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:13:04.260551 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ffc70-4124-4faa-b6f0-c0b451e75c2a None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:13:04.261917 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 610/1228] 10.222.0.65 () {54 vars in 921 bytes} [Tue Jul 26 00:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:13:04.267055 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7bf24-3943-4828-9d8c-4a762978102b None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:13:04.267475 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7bf24-3943-4828-9d8c-4a762978102b None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:13:04.267746 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7bf24-3943-4828-9d8c-4a762978102b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:13:04.297717 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-9ae7bf24-3943-4828-9d8c-4a762978102b None None] MFA Rules not processed for user `a513753b2f49408baf24402f1fa3c7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:13:04.298945 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-9ae7bf24-3943-4828-9d8c-4a762978102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:13:04.308565 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 619/1229] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Jul 26 00:13:04 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:13:04.321341 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ffc70-4124-4faa-b6f0-c0b451e75c2a None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:13:04.334727 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ffc70-4124-4faa-b6f0-c0b451e75c2a None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:13:04.340928 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f9015-f631-4de5-bca7-e07d92e6a920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:13:04.341534 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f9015-f631-4de5-bca7-e07d92e6a920 service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:13:04.341811 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f9015-f631-4de5-bca7-e07d92e6a920 service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:13:04.342083 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f9015-f631-4de5-bca7-e07d92e6a920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:13:04.350555 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f9015-f631-4de5-bca7-e07d92e6a920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:13:04.353317 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f9015-f631-4de5-bca7-e07d92e6a920 service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:13:04.363118 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 611/1230] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:13:04 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:13:14.292803 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=17 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:13:14.359076 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=6 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:14:27.103418 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7bf24-3943-4828-9d8c-4a762978102b None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:14:27.123585 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7bf24-3943-4828-9d8c-4a762978102b None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:14:27.128588 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00524217-f8ed-480d-b996-be486bb99ff1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88b351fcdad4f2ab1a42e2ac3ee0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:14:27.129188 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00524217-f8ed-480d-b996-be486bb99ff1 service placement] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:14:27.129466 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00524217-f8ed-480d-b996-be486bb99ff1 service placement] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:14:27.129737 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00524217-f8ed-480d-b996-be486bb99ff1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:14:27.137823 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00524217-f8ed-480d-b996-be486bb99ff1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:14:27.139445 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00524217-f8ed-480d-b996-be486bb99ff1 service placement] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:14:27.149390 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 620/1231] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:14:27 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:14:37.145469 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=10 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:14:48.667196 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee50a-44f9-43e0-9f41-7cdb84b34c7d None None] REQUEST_METHOD: `POST` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:14:48.667691 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee50a-44f9-43e0-9f41-7cdb84b34c7d None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:14:48.667788 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee50a-44f9-43e0-9f41-7cdb84b34c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:14:48.686306 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.auth.core [None req-830ee50a-44f9-43e0-9f41-7cdb84b34c7d None None] MFA Rules not processed for user `7a6f7e4737f74281849fa75181e5120d`. Rule list: `[]` (Enabled: `True`). {{(pid=87309) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:14:48.687547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-830ee50a-44f9-43e0-9f41-7cdb84b34c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:14:48.694547 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 612/1232] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:14:48 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:14:58.683317 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=3 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:15:12.975115 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04eaaf-3253-4332-8a48-4e72f13de951 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:15:12.976211 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04eaaf-3253-4332-8a48-4e72f13de951 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:15:12.976647 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04eaaf-3253-4332-8a48-4e72f13de951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:15:12.998453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-8c04eaaf-3253-4332-8a48-4e72f13de951 None None] MFA Rules not processed for user `2f4210ffab7f47df822b7aaa8bfd0196`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:15:12.999886 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-8c04eaaf-3253-4332-8a48-4e72f13de951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:15:13.015102 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 621/1233] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:15:12 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:15:17.712450 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee50a-44f9-43e0-9f41-7cdb84b34c7d None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:15:17.738643 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee50a-44f9-43e0-9f41-7cdb84b34c7d None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:15:17.744822 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534095c-6255-4280-bd39-7e8f9859185a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:15:17.745866 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534095c-6255-4280-bd39-7e8f9859185a service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:15:17.746334 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534095c-6255-4280-bd39-7e8f9859185a service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:15:17.747315 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534095c-6255-4280-bd39-7e8f9859185a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:15:17.758333 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534095c-6255-4280-bd39-7e8f9859185a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:15:17.761029 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534095c-6255-4280-bd39-7e8f9859185a service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:15:17.774209 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 613/1234] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:15:17 2022] GET /identity/v3/auth/tokens => generated 2802 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:15:22.993184 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=3 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:15:27.768713 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=10 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:15:43.019635 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04eaaf-3253-4332-8a48-4e72f13de951 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:15:43.033175 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04eaaf-3253-4332-8a48-4e72f13de951 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:15:43.038017 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e041f-b114-4a84-a3b6-1f28d5694524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:15:43.038622 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e041f-b114-4a84-a3b6-1f28d5694524 service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:15:43.038937 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e041f-b114-4a84-a3b6-1f28d5694524 service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:15:43.039791 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e041f-b114-4a84-a3b6-1f28d5694524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:15:43.047371 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e041f-b114-4a84-a3b6-1f28d5694524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:15:43.048927 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e041f-b114-4a84-a3b6-1f28d5694524 service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:15:43.059926 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 622/1235] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:15:43 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:15:43.213130 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534095c-6255-4280-bd39-7e8f9859185a service nova] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:15:43.216091 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e041f-b114-4a84-a3b6-1f28d5694524 service nova] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:15:43.222739 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534095c-6255-4280-bd39-7e8f9859185a service nova] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:15:43.225019 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e041f-b114-4a84-a3b6-1f28d5694524 service nova] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:15:43.226297 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397c91-a938-402b-904b-a960e0c1b67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:15:43.227539 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397c91-a938-402b-904b-a960e0c1b67d service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:15:43.228110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397c91-a938-402b-904b-a960e0c1b67d service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:15:43.228110 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397c91-a938-402b-904b-a960e0c1b67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:15:43.229359 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162a991-fe03-40d1-98af-daa7418b870b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:15:43.229980 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a991-fe03-40d1-98af-daa7418b870b service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:15:43.230257 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a991-fe03-40d1-98af-daa7418b870b service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:15:43.230532 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a991-fe03-40d1-98af-daa7418b870b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:15:43.237613 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a397c91-a938-402b-904b-a960e0c1b67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:15:43.237766 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162a991-fe03-40d1-98af-daa7418b870b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:15:43.239129 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162a991-fe03-40d1-98af-daa7418b870b service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:15:43.239257 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a397c91-a938-402b-904b-a960e0c1b67d service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:15:43.247812 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 623/1236] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:15:43 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 00:15:43.251171 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 614/1237] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:15:43 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:15:44.466560 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162a991-fe03-40d1-98af-daa7418b870b service neutron] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:15:44.475989 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162a991-fe03-40d1-98af-daa7418b870b service neutron] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:15:44.480905 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6551f-7ca1-4e5e-938e-793fbb9bf349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:15:44.481551 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6551f-7ca1-4e5e-938e-793fbb9bf349 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:15:44.481836 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6551f-7ca1-4e5e-938e-793fbb9bf349 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:15:44.482121 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6551f-7ca1-4e5e-938e-793fbb9bf349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:15:44.493732 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6551f-7ca1-4e5e-938e-793fbb9bf349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:15:44.495312 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6551f-7ca1-4e5e-938e-793fbb9bf349 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:15:44.506792 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 624/1238] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:15:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:15:53.246737 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=6 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:15:54.501722 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=18 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:16:33.630051 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397c91-a938-402b-904b-a960e0c1b67d service neutron] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:16:33.645142 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397c91-a938-402b-904b-a960e0c1b67d service neutron] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:16:33.659055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378e111-b528-4be2-86c7-2342b517de5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:16:33.660783 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378e111-b528-4be2-86c7-2342b517de5a service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:16:33.661378 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378e111-b528-4be2-86c7-2342b517de5a service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:16:33.661845 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378e111-b528-4be2-86c7-2342b517de5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:16:33.691433 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378e111-b528-4be2-86c7-2342b517de5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:16:33.694103 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378e111-b528-4be2-86c7-2342b517de5a service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:16:33.706698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 615/1239] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:16:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:16:41.247491 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6551f-7ca1-4e5e-938e-793fbb9bf349 service neutron] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:16:41.256870 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6551f-7ca1-4e5e-938e-793fbb9bf349 service neutron] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:16:41.260472 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bce6f7-1d60-42c4-8f63-01869c49a979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:16:41.261073 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce6f7-1d60-42c4-8f63-01869c49a979 service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:16:41.261354 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce6f7-1d60-42c4-8f63-01869c49a979 service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:16:41.261628 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bce6f7-1d60-42c4-8f63-01869c49a979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:16:41.323231 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bce6f7-1d60-42c4-8f63-01869c49a979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:16:41.324691 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bce6f7-1d60-42c4-8f63-01869c49a979 service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:16:41.342997 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 625/1240] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:16:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:16:43.701286 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=6 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:16:44.558352 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65c06-06b6-4b02-aab5-5e530a6490a1 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:16:44.558648 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65c06-06b6-4b02-aab5-5e530a6490a1 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:16:44.559129 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65c06-06b6-4b02-aab5-5e530a6490a1 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:16:44.560588 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 616/1241] 10.222.0.65 () {54 vars in 921 bytes} [Tue Jul 26 00:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:16:44.574768 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450fef-aac3-43d8-8070-e95f446abc85 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:16:44.575273 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450fef-aac3-43d8-8070-e95f446abc85 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:16:44.575372 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450fef-aac3-43d8-8070-e95f446abc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:16:44.755464 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-b3450fef-aac3-43d8-8070-e95f446abc85 None None] MFA Rules not processed for user `d88b351fcdad4f2ab1a42e2ac3ee0856`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:16:44.756683 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-b3450fef-aac3-43d8-8070-e95f446abc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:16:44.765269 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 626/1242] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Jul 26 00:16:44 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:16:44.776983 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc65c06-06b6-4b02-aab5-5e530a6490a1 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:16:44.790698 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc65c06-06b6-4b02-aab5-5e530a6490a1 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:16:44.795659 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaf57f-b4ed-4e2b-b07e-23079bca19d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88b351fcdad4f2ab1a42e2ac3ee0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:16:44.796268 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaf57f-b4ed-4e2b-b07e-23079bca19d5 service placement] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:16:44.796550 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaf57f-b4ed-4e2b-b07e-23079bca19d5 service placement] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:16:44.796826 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaf57f-b4ed-4e2b-b07e-23079bca19d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:16:44.805717 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaf57f-b4ed-4e2b-b07e-23079bca19d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:16:44.807384 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaf57f-b4ed-4e2b-b07e-23079bca19d5 service placement] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:16:44.818034 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 617/1243] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:16:44 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:16:48.042821 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450fef-aac3-43d8-8070-e95f446abc85 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:16:48.056072 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450fef-aac3-43d8-8070-e95f446abc85 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:16:48.060786 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:16:48.061428 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:16:48.061707 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:16:48.061983 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] PATH_INFO: `/v3/users/7a6f7e4737f74281849fa75181e5120d` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:16:48.063792 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a6f7e4737f74281849fa75181e5120d)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:16:48.065755 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:16:48.112958 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a6f7e4737f74281849fa75181e5120d'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.113649 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a6f7e4737f74281849fa75181e5120d'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.126249 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a6f7e4737f74281849fa75181e5120d'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.133658 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a6f7e4737f74281849fa75181e5120d'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.140449 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a6f7e4737f74281849fa75181e5120d'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.146377 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 627/1244] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Jul 26 00:16:48 2022] DELETE /identity/v3/users/7a6f7e4737f74281849fa75181e5120d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:16:48.327164 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaf57f-b4ed-4e2b-b07e-23079bca19d5 service placement] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:16:48.338384 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaf57f-b4ed-4e2b-b07e-23079bca19d5 service placement] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:16:48.395185 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:16:48.395820 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:16:48.396099 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:16:48.396372 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] PATH_INFO: `/v3/projects/6cce7b8438464c409602d9c9b61e6b66` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:16:48.397495 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cce7b8438464c409602d9c9b61e6b66)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:16:48.399431 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:16:48.445094 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cce7b8438464c409602d9c9b61e6b66', 'request_id': 'req-6ec85144-91c2-473b-89d9-436105cbb0c9'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.450692 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cce7b8438464c409602d9c9b61e6b66', 'request_id': 'req-6ec85144-91c2-473b-89d9-436105cbb0c9'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.457806 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cce7b8438464c409602d9c9b61e6b66', 'request_id': 'req-6ec85144-91c2-473b-89d9-436105cbb0c9'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.468948 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] The token cache is being invalidate because project 6cce7b8438464c409602d9c9b61e6b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 00:16:48.469751 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.470461 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.471992 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 618/1245] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Jul 26 00:16:48 2022] DELETE /identity/v3/projects/6cce7b8438464c409602d9c9b61e6b66 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:16:48.476174 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:16:48.477569 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:16:48.491459 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65169490-286c-4d7c-a49d-f50613005ee6 admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:16:48.515320 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:16:48.550286 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53134f2-fc76-4bec-8924-8caf4c1c5258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:16:48.551003 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53134f2-fc76-4bec-8924-8caf4c1c5258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:16:48.551241 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53134f2-fc76-4bec-8924-8caf4c1c5258 admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:16:48.551516 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53134f2-fc76-4bec-8924-8caf4c1c5258 admin admin] PATH_INFO: `/v3/users/9c955b6515364b289edced764104a162` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:16:48.553274 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53134f2-fc76-4bec-8924-8caf4c1c5258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c955b6515364b289edced764104a162)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:16:48.555671 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53134f2-fc76-4bec-8924-8caf4c1c5258 admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:16:48.603191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-a53134f2-fc76-4bec-8924-8caf4c1c5258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c955b6515364b289edced764104a162'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.604392 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-a53134f2-fc76-4bec-8924-8caf4c1c5258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c955b6515364b289edced764104a162'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.616685 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-a53134f2-fc76-4bec-8924-8caf4c1c5258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c955b6515364b289edced764104a162'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.623603 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-a53134f2-fc76-4bec-8924-8caf4c1c5258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c955b6515364b289edced764104a162'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.631412 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-a53134f2-fc76-4bec-8924-8caf4c1c5258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c955b6515364b289edced764104a162'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.637196 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 628/1246] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Jul 26 00:16:48 2022] DELETE /identity/v3/users/9c955b6515364b289edced764104a162 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:16:48.809795 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:16:48.811282 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:16:48.825704 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec85144-91c2-473b-89d9-436105cbb0c9 admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:16:48.882566 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:16:48.883234 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:16:48.883535 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:16:48.883790 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] PATH_INFO: `/v3/projects/4f67ffde61fb433a8dba35bdf89e5043` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:16:48.884923 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f67ffde61fb433a8dba35bdf89e5043)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:16:48.886867 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:16:48.907342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:16:48.933192 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f67ffde61fb433a8dba35bdf89e5043', 'request_id': 'req-01ad6490-8f84-4554-b76d-5446d926e0a1'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.939521 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f67ffde61fb433a8dba35bdf89e5043', 'request_id': 'req-01ad6490-8f84-4554-b76d-5446d926e0a1'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.946884 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f67ffde61fb433a8dba35bdf89e5043', 'request_id': 'req-01ad6490-8f84-4554-b76d-5446d926e0a1'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.958007 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] The token cache is being invalidate because project 4f67ffde61fb433a8dba35bdf89e5043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 00:16:48.958295 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.958956 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:16:48.960811 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 619/1247] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Jul 26 00:16:48 2022] DELETE /identity/v3/projects/4f67ffde61fb433a8dba35bdf89e5043 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:16:58.633800 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:16:58.954933 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:17:09.290855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137872e5-582c-4ab7-87d7-0d29a5113927 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:17:09.291370 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137872e5-582c-4ab7-87d7-0d29a5113927 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:17:09.291469 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137872e5-582c-4ab7-87d7-0d29a5113927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:17:09.310396 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-137872e5-582c-4ab7-87d7-0d29a5113927 None None] MFA Rules not processed for user `2f4210ffab7f47df822b7aaa8bfd0196`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:17:09.311653 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-137872e5-582c-4ab7-87d7-0d29a5113927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:17:09.364821 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 629/1248] 10.222.0.65 () {58 vars in 958 bytes} [Tue Jul 26 00:17:09 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 00:17:09.675795 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:17:09.677896 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:17:09.732767 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad6490-8f84-4554-b76d-5446d926e0a1 admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:17:09.736313 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8be57-a6b1-4c8e-a495-0003f0912d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:17:09.736919 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8be57-a6b1-4c8e-a495-0003f0912d4d service neutron] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:17:09.737196 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8be57-a6b1-4c8e-a495-0003f0912d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:17:09.737468 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8be57-a6b1-4c8e-a495-0003f0912d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:17:09.739717 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-1bc8be57-a6b1-4c8e-a495-0003f0912d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:17:09.748924 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8be57-a6b1-4c8e-a495-0003f0912d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:17:09.750379 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8be57-a6b1-4c8e-a495-0003f0912d4d service neutron] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:17:09.758969 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 620/1249] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:17:09 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:17:10.193968 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137872e5-582c-4ab7-87d7-0d29a5113927 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:17:10.195369 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-137872e5-582c-4ab7-87d7-0d29a5113927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:17:10.270483 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137872e5-582c-4ab7-87d7-0d29a5113927 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:17:10.275625 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf316afd-d3f1-4be7-9c1a-c159b0712310 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88b351fcdad4f2ab1a42e2ac3ee0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:17:10.276275 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf316afd-d3f1-4be7-9c1a-c159b0712310 service placement] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:17:10.276555 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf316afd-d3f1-4be7-9c1a-c159b0712310 service placement] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:17:10.276831 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf316afd-d3f1-4be7-9c1a-c159b0712310 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:17:10.278590 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-cf316afd-d3f1-4be7-9c1a-c159b0712310 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:17:10.290485 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf316afd-d3f1-4be7-9c1a-c159b0712310 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:17:10.292113 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf316afd-d3f1-4be7-9c1a-c159b0712310 service placement] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:17:10.302134 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 630/1250] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:17:10 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:17:19.183904 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8be57-a6b1-4c8e-a495-0003f0912d4d service neutron] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:17:19.185628 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-1bc8be57-a6b1-4c8e-a495-0003f0912d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:17:19.259564 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8be57-a6b1-4c8e-a495-0003f0912d4d service neutron] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:17:19.264506 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7023168-ef4c-4d77-a763-e6cbabd65d09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:17:19.265140 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7023168-ef4c-4d77-a763-e6cbabd65d09 service nova] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:17:19.265417 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7023168-ef4c-4d77-a763-e6cbabd65d09 service nova] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:17:19.265689 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7023168-ef4c-4d77-a763-e6cbabd65d09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:17:19.267421 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-d7023168-ef4c-4d77-a763-e6cbabd65d09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:17:19.278478 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7023168-ef4c-4d77-a763-e6cbabd65d09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:17:19.280086 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7023168-ef4c-4d77-a763-e6cbabd65d09 service nova] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:17:19.289479 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 621/1251] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:17:19 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:17:20.297627 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=57 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:17:29.285678 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=58 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:19:00.386036 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf316afd-d3f1-4be7-9c1a-c159b0712310 service placement] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:19:00.445169 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf316afd-d3f1-4be7-9c1a-c159b0712310 service placement] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:19:00.453003 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d52556-e4d7-4574-829d-cb02bbf3192a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a513753b2f49408baf24402f1fa3c7e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:19:00.453656 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d52556-e4d7-4574-829d-cb02bbf3192a service nova] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:19:00.454453 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d52556-e4d7-4574-829d-cb02bbf3192a service nova] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:19:00.454793 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d52556-e4d7-4574-829d-cb02bbf3192a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:19:00.456808 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-79d52556-e4d7-4574-829d-cb02bbf3192a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:19:00.497228 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d52556-e4d7-4574-829d-cb02bbf3192a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:19:00.499559 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d52556-e4d7-4574-829d-cb02bbf3192a service nova] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:19:00.514781 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 631/1252] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:19:00 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:19:10.510441 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=28 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:19:28.420061 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7023168-ef4c-4d77-a763-e6cbabd65d09 service nova] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:19:28.421462 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-d7023168-ef4c-4d77-a763-e6cbabd65d09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:19:28.484141 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7023168-ef4c-4d77-a763-e6cbabd65d09 service nova] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:19:28.489935 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933f221-c880-48cd-9d4c-536135900624 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88b351fcdad4f2ab1a42e2ac3ee0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:19:28.490573 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933f221-c880-48cd-9d4c-536135900624 service placement] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:19:28.490895 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933f221-c880-48cd-9d4c-536135900624 service placement] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:19:28.491173 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933f221-c880-48cd-9d4c-536135900624 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:19:28.492912 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-e933f221-c880-48cd-9d4c-536135900624 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:19:28.504182 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933f221-c880-48cd-9d4c-536135900624 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:19:28.505761 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933f221-c880-48cd-9d4c-536135900624 service placement] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:19:28.515438 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 622/1253] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:19:28 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:19:38.511467 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=28 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:19:43.501529 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d52556-e4d7-4574-829d-cb02bbf3192a service nova] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:19:43.511400 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d52556-e4d7-4574-829d-cb02bbf3192a service nova] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:19:43.514994 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ea5fd-ff49-4539-89d6-db237f17006b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e34b7f817f452faabd2d32d1af3ab8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:19:43.515608 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ea5fd-ff49-4539-89d6-db237f17006b service neutron] REQUEST_METHOD: `GET` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:19:43.515890 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ea5fd-ff49-4539-89d6-db237f17006b service neutron] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:19:43.516166 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ea5fd-ff49-4539-89d6-db237f17006b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:19:43.517896 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-210ea5fd-ff49-4539-89d6-db237f17006b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:19:43.600440 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ea5fd-ff49-4539-89d6-db237f17006b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:19:43.601855 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ea5fd-ff49-4539-89d6-db237f17006b service neutron] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:19:43.611128 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 632/1254] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:19:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:19:46.716600 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7b00-160d-4acd-ac39-ed7196529856 None None] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:19:46.717082 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7b00-160d-4acd-ac39-ed7196529856 None None] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:19:46.717168 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7b00-160d-4acd-ac39-ed7196529856 None None] PATH_INFO: `/` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:19:46.718507 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 623/1255] 10.222.0.65 () {54 vars in 921 bytes} [Tue Jul 26 00:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 00:19:46.747772 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eb5c9-dca5-4563-9a3a-84e9d98150b5 None None] REQUEST_METHOD: `POST` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:19:46.761069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eb5c9-dca5-4563-9a3a-84e9d98150b5 None None] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:19:46.761069 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eb5c9-dca5-4563-9a3a-84e9d98150b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:19:46.789359 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.auth.core [None req-9a5eb5c9-dca5-4563-9a3a-84e9d98150b5 None None] MFA Rules not processed for user `d88b351fcdad4f2ab1a42e2ac3ee0856`. Rule list: `[]` (Enabled: `True`). {{(pid=87308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 00:19:46.790264 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-9a5eb5c9-dca5-4563-9a3a-84e9d98150b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:19:46.800597 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 633/1256] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Jul 26 00:19:46 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 00:19:46.811693 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd7b00-160d-4acd-ac39-ed7196529856 None None] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:19:46.825878 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd7b00-160d-4acd-ac39-ed7196529856 None None] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:19:46.831209 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d865a2-145b-4bde-ae39-6efaec7fb3be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88b351fcdad4f2ab1a42e2ac3ee0856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d685fe7e12e4d86a5d5db9253e7e11f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:19:46.832503 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d865a2-145b-4bde-ae39-6efaec7fb3be service placement] REQUEST_METHOD: `GET` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:19:46.832918 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d865a2-145b-4bde-ae39-6efaec7fb3be service placement] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:19:46.833288 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d865a2-145b-4bde-ae39-6efaec7fb3be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:19:46.842606 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d865a2-145b-4bde-ae39-6efaec7fb3be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:19:46.844230 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d865a2-145b-4bde-ae39-6efaec7fb3be service placement] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:19:46.856921 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 624/1257] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Jul 26 00:19:46 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 00:19:49.903265 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5eb5c9-dca5-4563-9a3a-84e9d98150b5 None None] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:19:49.905311 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-9a5eb5c9-dca5-4563-9a3a-84e9d98150b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:19:49.927334 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5eb5c9-dca5-4563-9a3a-84e9d98150b5 None None] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:19:49.932678 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:19:49.933602 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:19:49.933882 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:19:49.934189 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] PATH_INFO: `/v3/users/2f4210ffab7f47df822b7aaa8bfd0196` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:19:49.935392 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4210ffab7f47df822b7aaa8bfd0196)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:19:49.937801 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:19:49.992662 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4210ffab7f47df822b7aaa8bfd0196'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:49.993381 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4210ffab7f47df822b7aaa8bfd0196'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.005918 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4210ffab7f47df822b7aaa8bfd0196'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.012579 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4210ffab7f47df822b7aaa8bfd0196'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.020741 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4210ffab7f47df822b7aaa8bfd0196'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.026527 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 634/1258] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Jul 26 00:19:49 2022] DELETE /identity/v3/users/2f4210ffab7f47df822b7aaa8bfd0196 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:19:50.200542 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d865a2-145b-4bde-ae39-6efaec7fb3be service placement] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:19:50.211169 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d865a2-145b-4bde-ae39-6efaec7fb3be service placement] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:19:50.268109 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:19:50.268746 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:19:50.269059 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:19:50.269359 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] PATH_INFO: `/v3/projects/b8fc93bd2c194a198b116e8048215204` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:19:50.270492 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8fc93bd2c194a198b116e8048215204)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:19:50.272480 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:19:50.316752 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8fc93bd2c194a198b116e8048215204', 'request_id': 'req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.322199 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8fc93bd2c194a198b116e8048215204', 'request_id': 'req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.328764 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8fc93bd2c194a198b116e8048215204', 'request_id': 'req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.340398 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] The token cache is being invalidate because project b8fc93bd2c194a198b116e8048215204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 00:19:50.340686 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.341314 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.342838 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 625/1259] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Jul 26 00:19:50 2022] DELETE /identity/v3/projects/b8fc93bd2c194a198b116e8048215204 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:19:50.347040 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] Authenticating user token {{(pid=87308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:19:50.348688 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.fernet_utils [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:19:50.361382 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d622b5e-1a28-4af0-bcf7-9fbc36e8bf2a admin admin] Validating token access rules against request {{(pid=87308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:19:50.391213 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:19:50.421825 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a91d8-3ee0-4273-a441-32eff62511ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:19:50.422462 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a91d8-3ee0-4273-a441-32eff62511ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:19:50.422770 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a91d8-3ee0-4273-a441-32eff62511ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:19:50.423050 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a91d8-3ee0-4273-a441-32eff62511ee admin admin] PATH_INFO: `/v3/users/28d814fbdd874024a8e28a0f24a740a7` {{(pid=87308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:19:50.424191 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a91d8-3ee0-4273-a441-32eff62511ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d814fbdd874024a8e28a0f24a740a7)` {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:19:50.426477 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a91d8-3ee0-4273-a441-32eff62511ee admin admin] RBAC: Authorization granted {{(pid=87308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:19:50.474696 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-648a91d8-3ee0-4273-a441-32eff62511ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d814fbdd874024a8e28a0f24a740a7'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.475520 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-648a91d8-3ee0-4273-a441-32eff62511ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d814fbdd874024a8e28a0f24a740a7'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.487309 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-648a91d8-3ee0-4273-a441-32eff62511ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d814fbdd874024a8e28a0f24a740a7'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.495977 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-648a91d8-3ee0-4273-a441-32eff62511ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d814fbdd874024a8e28a0f24a740a7'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.502858 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG keystone.notifications [None req-648a91d8-3ee0-4273-a441-32eff62511ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d814fbdd874024a8e28a0f24a740a7'} {{(pid=87308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.509109 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: [pid: 87308|app: 0|req: 635/1260] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Jul 26 00:19:50 2022] DELETE /identity/v3/users/28d814fbdd874024a8e28a0f24a740a7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:19:50.680466 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] Authenticating user token {{(pid=87309) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 00:19:50.682058 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.fernet_utils [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87309) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 00:19:50.695991 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda5b08-b5b8-4db1-ad06-c4b0557c6547 admin admin] Validating token access rules against request {{(pid=87309) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 00:19:50.753807 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c1cfffdc2f44dac84acffeaa3f395e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a89d9c4e1862458dba91de9a0e7a6b24', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87309) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 00:19:50.754441 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 00:19:50.754737 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 00:19:50.755009 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49 admin admin] PATH_INFO: `/v3/projects/c2fa795dc0724245b62113678acde975` {{(pid=87309) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 00:19:50.756142 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2fa795dc0724245b62113678acde975)` {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 00:19:50.758055 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49 admin admin] RBAC: Authorization granted {{(pid=87309) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 00:19:50.778955 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:19:50.805974 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2fa795dc0724245b62113678acde975', 'request_id': 'req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.811536 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2fa795dc0724245b62113678acde975', 'request_id': 'req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.818520 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2fa795dc0724245b62113678acde975', 'request_id': 'req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49'} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.829396 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49 admin admin] The token cache is being invalidate because project c2fa795dc0724245b62113678acde975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87309) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 00:19:50.829683 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.830382 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG keystone.notifications [None req-58e0b22f-a344-4eb4-b44e-7021ebaa4b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87309) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 00:19:50.832528 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: [pid: 87309|app: 0|req: 626/1261] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Jul 26 00:19:50 2022] DELETE /identity/v3/projects/c2fa795dc0724245b62113678acde975 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 00:20:00.505701 dv-osbrick-849840-4-ceph devstack@keystone.service[87308]: DEBUG dbcounter [-] [87308] Writing DB stats keystone:SELECT=39,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 00:20:00.826342 dv-osbrick-849840-4-ceph devstack@keystone.service[87309]: DEBUG dbcounter [-] [87309] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87309) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}